-- Logs begin at Mon 2022-05-23 14:39:16 UTC, end at Mon 2022-05-23 16:00:29 UTC. -- May 23 15:31:56.393406 dv-cinder-840678-12-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 23 15:31:56.400629 dv-cinder-840678-12-iscsi devstack@n-api.service[110434]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 23 15:31:56.404615 dv-cinder-840678-12-iscsi devstack@n-api.service[110434]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 23 15:31:56 2022] *** May 23 15:31:56.404615 dv-cinder-840678-12-iscsi devstack@n-api.service[110434]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 23 15:31:56.404615 dv-cinder-840678-12-iscsi devstack@n-api.service[110434]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 23 15:31:56.404615 dv-cinder-840678-12-iscsi devstack@n-api.service[110434]: nodename: dv-cinder-840678-12-iscsi May 23 15:31:56.404615 dv-cinder-840678-12-iscsi devstack@n-api.service[110434]: machine: x86_64 May 23 15:31:56.404615 dv-cinder-840678-12-iscsi devstack@n-api.service[110434]: clock source: unix May 23 15:31:56.404615 dv-cinder-840678-12-iscsi devstack@n-api.service[110434]: pcre jit disabled May 23 15:31:56.404615 dv-cinder-840678-12-iscsi devstack@n-api.service[110434]: detected number of CPU cores: 4 May 23 15:31:56.404615 dv-cinder-840678-12-iscsi devstack@n-api.service[110434]: current working directory: / May 23 15:31:56.404615 dv-cinder-840678-12-iscsi devstack@n-api.service[110434]: detected binary path: /usr/bin/uwsgi-core May 23 15:31:56.404615 dv-cinder-840678-12-iscsi devstack@n-api.service[110434]: your processes number limit is 47680 May 23 15:31:56.404615 dv-cinder-840678-12-iscsi devstack@n-api.service[110434]: your memory page size is 4096 bytes May 23 15:31:56.404615 dv-cinder-840678-12-iscsi devstack@n-api.service[110434]: detected max file descriptor number: 2048 May 23 15:31:56.404615 dv-cinder-840678-12-iscsi devstack@n-api.service[110434]: lock engine: pthread robust mutexes May 23 15:31:56.404615 dv-cinder-840678-12-iscsi devstack@n-api.service[110434]: thunder lock: enabled May 23 15:31:56.404615 dv-cinder-840678-12-iscsi devstack@n-api.service[110434]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 23 15:31:56.404615 dv-cinder-840678-12-iscsi devstack@n-api.service[110434]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 23 15:31:56.448649 dv-cinder-840678-12-iscsi devstack@n-api.service[110434]: Python main interpreter initialized at 0x5581541989c0 May 23 15:31:56.448649 dv-cinder-840678-12-iscsi devstack@n-api.service[110434]: python threads support enabled May 23 15:31:56.448649 dv-cinder-840678-12-iscsi devstack@n-api.service[110434]: your server socket listen backlog is limited to 100 connections May 23 15:31:56.448649 dv-cinder-840678-12-iscsi devstack@n-api.service[110434]: your mercy for graceful operations on workers is 90 seconds May 23 15:31:56.451727 dv-cinder-840678-12-iscsi devstack@n-api.service[110434]: mapped 403077 bytes (393 KB) for 2 cores May 23 15:31:56.451727 dv-cinder-840678-12-iscsi devstack@n-api.service[110434]: *** Operational MODE: preforking *** May 23 15:31:56.451727 dv-cinder-840678-12-iscsi devstack@n-api.service[110434]: *** uWSGI is running in multiple interpreter mode *** May 23 15:31:56.451727 dv-cinder-840678-12-iscsi devstack@n-api.service[110434]: spawned uWSGI master process (pid: 110434) May 23 15:31:56.451727 dv-cinder-840678-12-iscsi devstack@n-api.service[110434]: spawned uWSGI worker 1 (pid: 110435, cores: 1) May 23 15:31:56.451727 dv-cinder-840678-12-iscsi devstack@n-api.service[110434]: spawned uWSGI worker 2 (pid: 110436, cores: 1) May 23 15:31:56.451727 dv-cinder-840678-12-iscsi devstack@n-api.service[110434]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 23 15:31:56.449527 dv-cinder-840678-12-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 23 15:31:57.607295 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 23 15:31:57.619561 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 23 15:31:58.333588 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 15:31:58.333588 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: from cryptography.utils import int_from_bytes May 23 15:31:58.333901 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 15:31:58.333901 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: from cryptography.utils import int_from_bytes May 23 15:31:58.334941 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 15:31:58.334941 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: from cryptography.utils import int_from_bytes May 23 15:31:58.335278 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 15:31:58.335278 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: from cryptography.utils import int_from_bytes May 23 15:32:00.914533 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 23 15:32:00.915196 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 23 15:32:00.915301 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 23 15:32:00.915301 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 23 15:32:00.915729 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 23 15:32:00.915729 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 23 15:32:00.915891 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 23 15:32:00.915984 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 23 15:32:00.916113 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 23 15:32:00.916261 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.916349 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 23 15:32:00.916588 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.916734 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.916910 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.917077 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.917267 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.917406 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.917599 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.917722 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.917911 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.918047 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.918233 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.918355 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.918552 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.918652 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.918879 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.918972 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.919142 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.919246 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.919458 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.919570 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.919781 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-840678-12-iscsi {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.919876 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.920104 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.920201 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-840678-12-iscsi {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.920411 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.920510 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.920710 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.920798 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.921016 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.921140 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.921880 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.921970 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.922207 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.922364 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.922515 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.922684 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.922991 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.923090 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.923445 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.923581 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.923753 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.923879 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.924067 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.924190 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.924371 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.924493 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.924702 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.924797 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.925011 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.925134 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.925345 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.925444 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.925655 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.925746 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.925958 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.926050 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.926277 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.926373 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.926581 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.926675 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-840678-12-iscsi {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.926969 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-840678-12-iscsi {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.927067 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.927534 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.927637 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.927841 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.927942 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.928150 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.928238 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.928556 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.928661 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.928861 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.928949 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.929190 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.929294 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.929552 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.929666 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.929815 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.929902 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.930116 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.930203 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.930440 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.930539 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.930759 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.930845 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.931070 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.931157 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.931373 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.931468 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.931670 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.931764 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.931976 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.932062 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.932277 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.932366 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.932586 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.932674 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.932883 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.932969 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.933155 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.933256 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.933447 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.933566 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.933750 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.933855 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.934068 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.934161 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.934383 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.934504 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.934641 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.934755 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.934891 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.934981 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.935163 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.935255 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.935476 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.935573 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.935789 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.935888 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.936093 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.936194 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.936396 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.936486 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.936697 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.936785 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.937576 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.937735 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.937884 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.938186 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.938303 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.938485 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.938601 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.938788 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.938928 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.939102 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.939229 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.939409 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.939527 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.939725 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.939836 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.940027 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.940130 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.940341 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.940443 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.940736 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.940846 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.940984 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.941112 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.941309 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.941408 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.941644 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.941739 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.941958 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.942048 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.942260 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.942361 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.942573 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.942669 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.942888 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.943049 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.943191 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.943292 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.943497 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.943607 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.943800 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.943898 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.944120 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.944224 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.944450 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.944690 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.944792 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.944997 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.945260 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.945364 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.945618 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.945711 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.945942 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.946221 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.946330 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.946538 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.946640 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.946847 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.946940 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.947150 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.947262 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.947456 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.947557 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.947759 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.947862 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.948105 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.948211 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.948363 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.948457 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.948664 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.948765 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.948968 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.949089 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.949302 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.949408 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.949606 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.949695 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.949907 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.950006 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.950210 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.950305 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.950510 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.950599 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.950815 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.950916 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.951120 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.951206 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.951428 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.951530 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.951727 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.951815 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.952028 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.952117 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.952327 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.952428 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.952667 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.952762 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.953051 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.953168 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.953383 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.953473 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.953687 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.953787 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.954004 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.954100 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.954302 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.954397 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.954603 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.954708 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.954919 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.955020 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.955216 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.955304 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.955515 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.955604 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.955827 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.955923 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.956122 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.956223 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.956422 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.956509 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.956725 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.956819 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.957023 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.957154 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.957352 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.957439 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.957661 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.957748 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.957956 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.958051 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.958255 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.958350 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.958553 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.958653 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.958849 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.958951 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.959145 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.959239 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.959437 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.959526 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.959749 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.959846 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.960063 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.960157 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.960365 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.960455 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.960672 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.960770 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.960972 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.961089 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.961311 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:32:00.961399 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.961641 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.961737 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.961970 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.962058 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.962307 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.962394 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.962616 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.962705 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.962939 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.963026 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.963255 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.963353 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.963566 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.963661 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.963876 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.963969 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.964187 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.964283 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.964501 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.964599 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.964804 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.964921 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.965132 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.965243 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.965441 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.965529 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.965753 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.965851 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.966069 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.966167 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.966394 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.966495 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.966703 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.966790 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.967015 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.967119 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.967328 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.967418 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.967632 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.967720 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.967940 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.968037 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.968370 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.968484 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.968692 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.968799 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.969000 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.969125 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.969363 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.969452 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.969692 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.969782 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.970004 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.970089 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.970313 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.970402 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.970627 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.970716 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.970935 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.971024 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.971246 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.971334 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.971553 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.971641 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.971871 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.971960 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.972189 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.972276 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.972497 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.972613 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.972808 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.972909 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.973138 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.973463 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.973463 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.973724 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.973812 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.973932 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.974103 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.974191 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.974412 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.974510 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.974722 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.974809 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.975043 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.975130 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.975352 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.975456 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.975661 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.975749 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.975974 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.976060 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.976280 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.976376 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.976584 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.976672 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.976886 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.976974 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.977214 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.977316 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.977515 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.977604 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.977816 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.977912 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.978121 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.978211 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.978420 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.978509 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.978734 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.978822 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.979045 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.979132 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.979346 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.979435 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.979656 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.979751 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.979961 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.980050 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.980264 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.980350 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.980572 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.980668 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.980875 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.980963 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.981197 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.981302 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.981503 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.981602 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.981808 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.981908 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.982107 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.982196 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.982427 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.982526 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.982729 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.982818 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.983029 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.983123 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.983340 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.983436 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.983638 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.984224 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.984474 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.984566 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.984784 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.984872 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.985122 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.985213 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.985451 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.985540 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.985765 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.985864 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.986072 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.986160 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.986392 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.986480 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.986702 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.986799 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.987010 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.987100 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.987334 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.987420 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.987656 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.987745 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.987958 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.988046 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.988261 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.988357 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.988573 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.988662 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.988877 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.988965 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.989205 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.989310 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.989524 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.989652 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.989807 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.989906 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.990107 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.990205 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.990403 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.990498 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.990705 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.990791 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.991006 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.991107 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.991307 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.991395 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.991603 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.991690 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.991900 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.991990 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.992201 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.992290 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.992506 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.992592 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.992808 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.992896 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.993128 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.993220 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.993434 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.993537 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.993730 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.993820 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.994068 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.994156 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.994369 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.994504 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.994706 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.994796 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.995034 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.995120 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.995347 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.995447 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.995656 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.995750 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.995962 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.996049 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.996272 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.996368 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.996576 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.996669 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.996882 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.996971 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.997220 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.997326 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.997529 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.997616 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.997842 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.997928 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.998146 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.998243 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.998460 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.998548 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.998766 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.998854 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.999071 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.999177 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:00.999436 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.000026 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.000283 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.000505 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.000708 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.000858 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.001048 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.001214 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.001397 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.001557 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.001710 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.001893 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.002027 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.002211 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.002337 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.002535 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.002632 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.002845 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.002935 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.003159 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.003248 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.003468 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.003564 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.003778 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.003868 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.004087 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.004181 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.004393 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.004482 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.004709 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.004803 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.005016 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.005124 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.005370 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.005467 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.005674 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.005762 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.005989 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.006080 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.006316 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.006404 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.006631 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.006719 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.006933 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.007028 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.007243 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.007330 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.007563 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.007651 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.007873 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.008035 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.008181 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.008270 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.008486 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.008576 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.008787 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.008882 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.009115 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.009218 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.009425 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.009514 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.009732 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.009829 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.010033 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.010121 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.010334 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.010428 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.010636 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.010739 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.010950 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.011046 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.011256 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.011350 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.011558 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.011653 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.011856 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.011944 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.012165 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.012257 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.012466 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.012555 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.012764 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.012852 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.013077 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.013166 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.013402 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.013491 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.013722 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.013808 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.014027 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.014115 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.014344 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.014440 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.014649 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.014736 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.014968 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.015068 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.015295 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.015449 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.015601 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.015921 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.016020 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.016236 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.016325 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.016537 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.016626 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.016841 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.016930 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.017170 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.017263 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.017495 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.017582 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.017809 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.017897 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.018111 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.018247 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.018418 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.018513 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.018733 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.018829 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.019040 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.019130 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.019349 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.019442 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.019654 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.019750 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.019962 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.020056 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.020272 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.020360 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.020581 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.020682 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.020893 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.020981 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.021222 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.021310 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.021530 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.021630 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.021835 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.021927 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.022138 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.022225 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.022447 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.022544 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.022750 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.022837 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.023057 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.023326 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.023430 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.023648 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.023744 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.023953 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.024040 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.024266 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.024362 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.024582 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.024826 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.024914 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.025178 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.025271 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.025494 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.025632 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.025810 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.025900 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.026126 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.026230 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.026443 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.026541 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.026769 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.026856 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.027075 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.027170 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.027385 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.027486 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.027690 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.027796 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.027994 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.028082 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.028294 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.028381 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.028599 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.028694 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.028900 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.028989 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.029226 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.029333 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.029527 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.029615 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.029826 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.029915 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.030130 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.030228 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.030428 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.030517 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.030825 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.030912 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.031132 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.031337 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.031458 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.031649 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.031766 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.031965 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.032053 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.032271 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.032368 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.032582 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.032677 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.032884 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.032972 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.033233 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.033325 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.033566 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.033667 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.033870 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.033968 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.034173 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.034262 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.034472 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.034562 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.034810 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.034914 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.035110 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.035199 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.035442 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.035531 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.035744 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.035841 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.036048 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.036137 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.036357 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.036447 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.036667 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.036756 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.036968 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.037054 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.037301 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.037388 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.037602 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.037703 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.037900 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.038096 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.038518 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.038601 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.038601 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.038750 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.038818 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.038883 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.039068 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.039156 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.039370 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.039468 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.039674 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.039761 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.039974 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.040080 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.040271 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.040360 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.040576 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.040669 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.040876 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.040971 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.041199 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.041290 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.041500 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.041587 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.041798 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.041900 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.042097 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.042186 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.042400 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.042488 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.042701 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.042802 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.042994 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.043081 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.043299 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.043387 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.043596 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.043686 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.043895 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.043981 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.044195 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.044283 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.044493 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.044583 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.044791 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.044879 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.045109 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.045199 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.045414 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.045503 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.045712 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.045851 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.046012 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.046101 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.046832 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.046931 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.047164 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.047419 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.047507 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.047735 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.047833 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.048045 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.048132 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.048345 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.048442 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.048647 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.048734 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.048951 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.049050 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.049282 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.049371 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.049584 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.049674 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.049883 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.049971 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.050183 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.050271 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.050479 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.050619 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.050777 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.050865 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.051074 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.051174 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.051381 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.051469 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.051679 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.051775 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.051974 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.052070 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.052525 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.052620 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.052849 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.052944 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.053171 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.053277 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.053491 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.053580 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.053794 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.053884 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.054093 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.054190 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.054392 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.054479 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.054688 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.054776 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.055020 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.055117 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.055316 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.055403 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.055624 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.055710 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.055939 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.056028 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.056250 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.056346 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.056562 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.056649 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.056864 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.056959 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.057200 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.057291 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.057509 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.057595 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.057808 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.057898 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.058116 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.058203 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.058419 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.058508 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.058727 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.058816 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.059025 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.059112 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.059322 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.059419 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.059639 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.059726 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.059945 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.060040 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.060250 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.060346 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.060559 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.060647 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.060868 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.060955 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.061201 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.061372 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.061499 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.061587 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.061802 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.061931 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.062161 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.062343 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.062457 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.062654 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.062746 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.062961 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.063064 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.063265 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.063354 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.063569 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.063659 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.063875 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.063978 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.064182 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.064278 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.064487 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.064584 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.064792 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.064894 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.065119 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.065212 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.065427 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.065515 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.065729 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.065829 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.066025 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.066158 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.066344 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.066470 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.066647 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.066782 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.066944 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.067094 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.067246 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.067404 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.067544 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.067716 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.067845 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.068033 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.068143 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.068345 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.068565 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.068662 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.068873 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.069093 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.069197 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.069386 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.069484 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.069697 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.069786 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.070007 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.070103 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.070311 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.070408 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.070613 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.070702 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.070940 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.071083 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.071247 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.071364 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.071550 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.071670 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.071854 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.071974 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.072158 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.072280 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.072478 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.072565 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.072781 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.072868 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.073126 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.073219 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.073485 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.073572 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.073786 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.073888 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.074084 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.074172 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.074445 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.074573 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.074682 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.074831 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.074971 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.075139 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.075287 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.075460 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.075696 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.075798 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.076000 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.076126 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.076299 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.076387 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.076677 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.076774 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.076992 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.077102 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.077320 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.077408 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.078153 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.078320 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.078472 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.078730 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.078820 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.079060 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.079152 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.079369 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.079465 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.079674 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.079771 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.079993 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.080081 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.080309 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.080410 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.080611 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.080699 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.080919 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.081037 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.081243 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.081386 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.081566 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.081697 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.081884 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.082017 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.082189 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.082344 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.082505 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.082650 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.082913 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.083003 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.083230 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.083320 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.083531 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.083619 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.083833 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.083920 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.084153 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.084242 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.084455 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.084546 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.084753 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.084841 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.085096 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.085189 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.085378 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.085467 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.085679 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.085769 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.085983 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.086080 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.086283 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.086372 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.086588 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.086686 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.086891 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.086979 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.087190 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.087285 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.087487 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.087583 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.087783 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.087877 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.088101 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.088189 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.088399 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.088497 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.088717 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.088805 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.089021 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.089129 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.089350 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.089450 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.089652 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.089741 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.089956 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.090043 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.090275 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.090364 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.090580 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.090667 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.090879 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.090966 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.091178 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.091267 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.091475 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.091570 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.091815 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.091904 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.092112 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.092202 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.092426 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.092516 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.092753 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.092841 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.093151 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.093258 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.093472 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.093654 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.093887 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.093986 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.094211 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.094302 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.094523 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.094611 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.094835 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.094937 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.095155 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.095244 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.095443 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.095575 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.095741 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.095840 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.096040 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.096136 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.096337 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.096423 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.096635 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.096733 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.096934 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.097023 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.097263 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.097358 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.097561 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.097651 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.097859 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.097947 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.098156 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.098243 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.098455 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.098544 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.098758 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.098845 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.099076 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.099171 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.099378 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.099467 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.099675 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.099763 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.100016 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.100117 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.100268 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.100359 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.100603 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.100692 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.100898 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.101031 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.101252 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.101343 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.101567 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.101656 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.101881 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.101982 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.102192 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.102280 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.102492 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.102579 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.102806 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.102902 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.103115 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.103260 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.103420 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.103510 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.103724 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.103822 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.104032 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.104121 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.104339 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.104430 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.104645 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.104853 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.104942 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.105203 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.105295 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.105522 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.105624 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.105836 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.105925 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.106149 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.106237 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.106462 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.106660 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.106758 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.106981 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.107069 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.107288 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.107377 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.107597 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.107686 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.107903 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.107990 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.108209 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.108372 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.108516 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.108605 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.109371 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.109510 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.109679 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.109780 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.109985 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.110074 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.110288 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.110377 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.110611 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.110708 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.110926 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.111022 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.111246 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.111344 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.111572 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.111670 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.111883 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.111972 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.112198 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.112287 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.112507 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.112597 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.112814 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.112904 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.113151 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.113259 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.113466 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.113556 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.113776 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.113864 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.114086 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.114181 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.114394 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.114481 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.114701 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.114787 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.115004 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.115092 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.115307 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.115408 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.115629 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.115724 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.115939 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.116030 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.116244 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.116344 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.116547 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.116635 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.116855 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.116945 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.117188 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.117279 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.117509 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.117705 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.117836 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.118024 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.118149 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.118357 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.118449 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.118682 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.118786 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.119007 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.119103 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.119323 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.119546 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.119653 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.119854 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.119943 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.120181 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.120277 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.120502 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.120600 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.120822 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.120910 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.121151 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.121242 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.121457 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.121547 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.121775 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.121863 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.122080 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.122167 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.122380 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.122468 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.122680 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.122775 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.122983 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.123072 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.123282 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.123511 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.123609 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.123858 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.123947 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.124171 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.124267 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.125023 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.125163 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.125353 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.125455 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.125700 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.125881 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.126010 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.126224 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.126336 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.126535 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.126686 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.126858 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.126947 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.127180 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.127270 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.127493 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.127591 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.127796 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.127893 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.128115 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.128204 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.128416 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.128514 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.128718 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.128815 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.129018 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.129134 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.129348 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.129438 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.129647 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.129737 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.129948 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.130050 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.130253 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.130343 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.130556 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.130653 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.130852 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.130940 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.131155 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.131253 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.131450 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.131539 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.131751 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.131886 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.132058 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.132149 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.132353 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.132441 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.132651 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.132749 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.132950 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.133038 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.133272 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.133360 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.133570 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.133671 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.133868 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.133965 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.134166 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.134253 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.134471 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.134573 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.134763 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.134859 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.135066 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.135155 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.135363 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.135459 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.135666 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.135755 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.135964 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.136051 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.136267 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.136367 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.136606 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.136690 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.136919 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.137009 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.137253 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.137342 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.137552 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.137647 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.137861 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.137950 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.138162 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.138422 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.138520 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.138761 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.138849 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.139064 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.139161 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.139403 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.139499 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.139714 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.139843 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.140060 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.140266 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.140366 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.140598 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.140690 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.140914 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.141012 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.141267 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.141359 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.141584 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.141672 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.141894 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.141996 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.142196 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.142285 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.142498 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.142587 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.142806 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.142907 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.143109 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.143197 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.143413 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.143501 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.143716 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.143807 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.144020 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.144116 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.144323 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.144413 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.144625 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.144715 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.144930 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.145026 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.145259 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.145351 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.145564 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.145656 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.145866 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.145954 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.146169 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.146271 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.146472 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.146560 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.146779 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.146874 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.147099 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.147196 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.147410 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.147499 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.147719 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.147806 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.148030 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.148131 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.148343 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.148432 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.148649 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.148738 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.148951 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.149039 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.149291 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.149394 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.149596 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.149684 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.149906 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.150002 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.150231 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.150320 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.150538 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.150626 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.150837 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.150927 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.151221 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.151317 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.151532 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.151671 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.151848 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.151936 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.152156 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.152242 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.152457 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.152553 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.152775 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.152864 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.153111 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.153204 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.153418 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.153525 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.153735 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.153824 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.154040 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.154128 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.154342 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.154431 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.154653 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.154742 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.154971 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.155067 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.155282 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.155372 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.155614 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.155714 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.155954 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.156054 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.156257 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.156348 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.156563 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.156651 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.156879 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.156976 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.157209 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.157311 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.157511 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.157601 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.157811 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.157914 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.158117 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.158206 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.158415 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.158504 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.158718 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.158818 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.159015 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.159103 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.159316 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.159405 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.159617 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.159719 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.159912 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.160042 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.160211 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.160302 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.160510 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.160608 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.160808 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.160904 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.161133 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.161225 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.161434 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.161535 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.161740 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.161830 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.162038 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.162174 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.162340 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.162431 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.162638 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.162733 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.162937 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.163031 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.163235 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.163332 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.163561 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.163650 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.163889 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.163987 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.164199 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.164287 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.164512 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.164599 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.164815 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.164912 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.165155 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.165258 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.165462 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.165559 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.165771 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.165868 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.166083 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.166172 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.166389 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.166478 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.166696 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.166792 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.167007 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.167096 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.167316 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.167404 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.167624 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.167714 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.167930 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.168018 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.168236 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.168324 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.168540 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.168630 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.168846 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.168942 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.169191 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.169284 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.169504 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.169601 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.169802 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.169896 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.170124 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.170221 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.170431 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.170519 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.170748 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.170836 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.171059 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.171161 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.171890 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.171980 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.172206 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.172293 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.172519 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.172616 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.172825 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.172913 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.173159 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.173250 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.173471 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.173571 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.173780 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.173875 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.174091 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.174179 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.174405 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.174496 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.174729 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.174818 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.175052 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.175139 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.175355 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.175453 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.175679 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.175768 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.175990 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.176077 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.176296 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.176385 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.176541 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 23 15:32:01.176629 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.176950 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.177555 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.177865 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.178174 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.178474 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:32:01.178713 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 23 15:32:01.236780 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: INFO dbcounter [None req-d1c66443-842d-4a95-8184-ce60bbe3ac19 None None] Registered counter for database nova_api May 23 15:32:01.237841 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: INFO dbcounter [None req-d13b097e-7449-4ee7-9031-1f7a72d2aba5 None None] Registered counter for database nova_api May 23 15:32:01.258836 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG oslo_db.sqlalchemy.engines [None req-d1c66443-842d-4a95-8184-ce60bbe3ac19 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110436) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 15:32:01.260115 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG oslo_db.sqlalchemy.engines [None req-d13b097e-7449-4ee7-9031-1f7a72d2aba5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110435) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 15:32:01.266053 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG dbcounter [-] [110436] Writer thread running {{(pid=110436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 15:32:01.267326 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG dbcounter [-] [110435] Writer thread running {{(pid=110435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 15:32:01.323044 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.context [None req-d1c66443-842d-4a95-8184-ce60bbe3ac19 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ad186f54-45d6-4a29-af7e-16215b0c4892(cell1) {{(pid=110436) load_cells /opt/stack/nova/nova/context.py:464}} May 23 15:32:01.323265 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.context [None req-d13b097e-7449-4ee7-9031-1f7a72d2aba5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ad186f54-45d6-4a29-af7e-16215b0c4892(cell1) {{(pid=110435) load_cells /opt/stack/nova/nova/context.py:464}} May 23 15:32:01.327183 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG oslo_concurrency.lockutils [None req-d13b097e-7449-4ee7-9031-1f7a72d2aba5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:01.327296 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG oslo_concurrency.lockutils [None req-d1c66443-842d-4a95-8184-ce60bbe3ac19 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:01.329528 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG oslo_concurrency.lockutils [None req-d1c66443-842d-4a95-8184-ce60bbe3ac19 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:01.329825 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG oslo_concurrency.lockutils [None req-d13b097e-7449-4ee7-9031-1f7a72d2aba5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=110435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:01.330333 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG oslo_concurrency.lockutils [None req-d1c66443-842d-4a95-8184-ce60bbe3ac19 None None] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:01.330605 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG oslo_concurrency.lockutils [None req-d13b097e-7449-4ee7-9031-1f7a72d2aba5 None None] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:32:01.332278 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG oslo_concurrency.lockutils [None req-d1c66443-842d-4a95-8184-ce60bbe3ac19 None None] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:01.332547 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG oslo_concurrency.lockutils [None req-d13b097e-7449-4ee7-9031-1f7a72d2aba5 None None] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110435) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:32:01.334292 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: INFO dbcounter [None req-d1c66443-842d-4a95-8184-ce60bbe3ac19 None None] Registered counter for database nova_cell0 May 23 15:32:01.334530 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: INFO dbcounter [None req-d13b097e-7449-4ee7-9031-1f7a72d2aba5 None None] Registered counter for database nova_cell0 May 23 15:32:01.338310 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: INFO dbcounter [None req-d1c66443-842d-4a95-8184-ce60bbe3ac19 None None] Registered counter for database nova_cell1 May 23 15:32:01.338422 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: INFO dbcounter [None req-d13b097e-7449-4ee7-9031-1f7a72d2aba5 None None] Registered counter for database nova_cell1 May 23 15:32:01.345738 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG oslo_db.sqlalchemy.engines [None req-d1c66443-842d-4a95-8184-ce60bbe3ac19 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110436) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 15:32:01.347788 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG oslo_db.sqlalchemy.engines [None req-d13b097e-7449-4ee7-9031-1f7a72d2aba5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110435) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 15:32:01.349232 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG oslo_db.sqlalchemy.engines [None req-d1c66443-842d-4a95-8184-ce60bbe3ac19 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110436) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 15:32:01.350615 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG oslo_db.sqlalchemy.engines [None req-d13b097e-7449-4ee7-9031-1f7a72d2aba5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110435) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 15:32:01.353940 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG dbcounter [-] [110436] Writer thread running {{(pid=110436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 15:32:01.356018 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG dbcounter [-] [110436] Writer thread running {{(pid=110436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 15:32:01.357442 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG dbcounter [-] [110435] Writer thread running {{(pid=110435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 15:32:01.358766 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG dbcounter [-] [110435] Writer thread running {{(pid=110435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 15:32:01.503774 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: INFO dbcounter [None req-d1c66443-842d-4a95-8184-ce60bbe3ac19 None None] Registered counter for database nova_cell0 May 23 15:32:01.511245 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: INFO dbcounter [None req-d13b097e-7449-4ee7-9031-1f7a72d2aba5 None None] Registered counter for database nova_cell0 May 23 15:32:01.512501 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG oslo_db.sqlalchemy.engines [None req-d1c66443-842d-4a95-8184-ce60bbe3ac19 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110436) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 15:32:01.517754 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG dbcounter [-] [110436] Writer thread running {{(pid=110436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 15:32:01.520393 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG oslo_db.sqlalchemy.engines [None req-d13b097e-7449-4ee7-9031-1f7a72d2aba5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110435) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 15:32:01.524749 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG dbcounter [-] [110435] Writer thread running {{(pid=110435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 15:32:02.035175 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: WARNING keystonemiddleware.auth_token [None req-d1c66443-842d-4a95-8184-ce60bbe3ac19 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 15:32:02.048957 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: WARNING keystonemiddleware.auth_token [None req-d1c66443-842d-4a95-8184-ce60bbe3ac19 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 15:32:02.084861 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: WARNING keystonemiddleware.auth_token [None req-d13b097e-7449-4ee7-9031-1f7a72d2aba5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 15:32:02.093755 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: WARNING keystonemiddleware.auth_token [None req-d13b097e-7449-4ee7-9031-1f7a72d2aba5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 15:32:02.456852 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: WARNING keystonemiddleware.auth_token [None req-d1c66443-842d-4a95-8184-ce60bbe3ac19 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 15:32:02.462802 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: WARNING keystonemiddleware.auth_token [None req-d1c66443-842d-4a95-8184-ce60bbe3ac19 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 15:32:02.469271 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5581541989c0 pid: 110436 (default app) May 23 15:32:02.471420 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-d1c66443-842d-4a95-8184-ce60bbe3ac19 None None] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:32:02.472621 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-d1c66443-842d-4a95-8184-ce60bbe3ac19 None None] 10.222.0.64 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001810 May 23 15:32:02.473038 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 1/1] 10.222.0.64 () {50 vars in 788 bytes} [Mon May 23 15:32:02 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:32:02.479308 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: WARNING keystonemiddleware.auth_token [None req-d13b097e-7449-4ee7-9031-1f7a72d2aba5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 15:32:02.485532 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: WARNING keystonemiddleware.auth_token [None req-d13b097e-7449-4ee7-9031-1f7a72d2aba5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 15:32:02.490840 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5581541989c0 pid: 110435 (default app) May 23 15:33:24.047570 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-d1c66443-842d-4a95-8184-ce60bbe3ac19 None None] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:24.048560 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-d1c66443-842d-4a95-8184-ce60bbe3ac19 None None] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 May 23 15:33:24.048956 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 2/2] 10.222.0.64 () {54 vars in 930 bytes} [Mon May 23 15:33:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:33:24.067549 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG dbcounter [-] [110435] Writing DB stats nova_api:SELECT=3 {{(pid=110435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:33:24.072329 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG dbcounter [-] [110435] Writing DB stats nova_cell1:SELECT=3 {{(pid=110435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:33:24.072329 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG dbcounter [-] [110435] Writing DB stats nova_cell0:SELECT=3 {{(pid=110435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:33:24.072329 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG dbcounter [-] [110435] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:33:24.528425 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-942a77bc-b91a-459b-9bdb-4f9fcc0b2b95 admin admin] Calling method '>' {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:24.559000 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-942a77bc-b91a-459b-9bdb-4f9fcc0b2b95 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.502830 May 23 15:33:24.559719 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 1/3] 10.222.0.64 () {60 vars in 1291 bytes} [Mon May 23 15:33:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:33:26.857805 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-d1c66443-842d-4a95-8184-ce60bbe3ac19 None None] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:26.859386 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-d1c66443-842d-4a95-8184-ce60bbe3ac19 None None] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002033 May 23 15:33:26.859966 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 3/4] 10.222.0.64 () {54 vars in 930 bytes} [Mon May 23 15:33:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:33:26.922487 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-b12e1f47-462e-4f67-a470-3caa823d6099 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 1, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "id": "c1", "name": "cirros256", "swap": 0, "rxtx_factor": 1.0}} {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:33:26.942017 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 15:33:26.942017 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: warnings.warn(msg) May 23 15:33:27.031942 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-b12e1f47-462e-4f67-a470-3caa823d6099 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.165662 May 23 15:33:27.032776 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 2/5] 10.222.0.64 () {64 vars in 1282 bytes} [Mon May 23 15:33:26 2022] POST /compute/v2.1/flavors => generated 407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 15:33:27.046476 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG dbcounter [-] [110436] Writing DB stats nova_api:SELECT=3 {{(pid=110436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:33:27.047434 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG dbcounter [-] [110436] Writing DB stats nova_cell0:SELECT=3 {{(pid=110436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:33:27.048541 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG dbcounter [-] [110436] Writing DB stats nova_cell1:SELECT=3 {{(pid=110436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:33:27.049315 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG dbcounter [-] [110436] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:33:27.256262 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-89fa2d40-0bd6-4e75-836d-889fa2071a00 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:33:27.258679 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 15:33:27.258679 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: warnings.warn(msg) May 23 15:33:27.400783 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-89fa2d40-0bd6-4e75-836d-889fa2071a00 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.360106 May 23 15:33:27.418537 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 4/6] 10.222.0.64 () {64 vars in 1335 bytes} [Mon May 23 15:33:27 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:33:29.728481 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-b12e1f47-462e-4f67-a470-3caa823d6099 admin admin] Calling method '>' {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:29.730090 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-b12e1f47-462e-4f67-a470-3caa823d6099 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 May 23 15:33:29.730483 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 3/7] 10.222.0.64 () {54 vars in 930 bytes} [Mon May 23 15:33:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:33:29.842936 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-55544488-509b-4846-9ef6-b1e0774fa68d admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "disk": 5, "name": "ds512M"}} {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:33:29.860828 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 15:33:29.860828 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: warnings.warn(msg) May 23 15:33:29.958760 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-55544488-509b-4846-9ef6-b1e0774fa68d admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.222082 May 23 15:33:29.959318 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 5/8] 10.222.0.64 () {64 vars in 1282 bytes} [Mon May 23 15:33:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 15:33:29.973904 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-3de6aefe-5e2a-4568-9074-a0f588ac20bf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:33:29.975505 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 15:33:29.975505 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: warnings.warn(msg) May 23 15:33:30.086031 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-3de6aefe-5e2a-4568-9074-a0f588ac20bf admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.116848 May 23 15:33:30.086547 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 4/9] 10.222.0.64 () {64 vars in 1335 bytes} [Mon May 23 15:33:29 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:33:32.377353 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-55544488-509b-4846-9ef6-b1e0774fa68d admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:32.378487 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-55544488-509b-4846-9ef6-b1e0774fa68d admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001668 May 23 15:33:32.378988 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 6/10] 10.222.0.64 () {54 vars in 930 bytes} [Mon May 23 15:33:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:33:32.439491 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-d9961e77-a09d-41a4-8f3e-2e9d2e27e5e6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "disk": 10}} {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:33:32.576180 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-d9961e77-a09d-41a4-8f3e-2e9d2e27e5e6 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.190947 May 23 15:33:32.576988 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 5/11] 10.222.0.64 () {64 vars in 1282 bytes} [Mon May 23 15:33:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 15:33:32.588637 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-9e1c4119-69da-4e44-9d33-4ee15ad6a1e3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:33:32.700585 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-9e1c4119-69da-4e44-9d33-4ee15ad6a1e3 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.115710 May 23 15:33:32.701265 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 7/12] 10.222.0.64 () {64 vars in 1335 bytes} [Mon May 23 15:33:32 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:33:34.993908 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-d9961e77-a09d-41a4-8f3e-2e9d2e27e5e6 admin admin] Calling method '>' {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:34.995032 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-d9961e77-a09d-41a4-8f3e-2e9d2e27e5e6 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 May 23 15:33:34.995441 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 6/13] 10.222.0.64 () {54 vars in 930 bytes} [Mon May 23 15:33:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:33:35.056233 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-26fd0b5b-edaf-47ed-8fba-f16fbd121abd admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 2, "disk": 10, "rxtx_factor": 1.0, "name": "ds2G", "swap": 0, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048}} {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:33:35.160323 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-26fd0b5b-edaf-47ed-8fba-f16fbd121abd admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.158616 May 23 15:33:35.160883 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 8/14] 10.222.0.64 () {64 vars in 1282 bytes} [Mon May 23 15:33:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 15:33:35.173021 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-b87f8247-4ae0-4908-9924-3e7d34029120 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:33:35.261524 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-b87f8247-4ae0-4908-9924-3e7d34029120 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091428 May 23 15:33:35.262122 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 7/15] 10.222.0.64 () {64 vars in 1335 bytes} [Mon May 23 15:33:35 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:33:37.586009 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-26fd0b5b-edaf-47ed-8fba-f16fbd121abd admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:37.587011 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-26fd0b5b-edaf-47ed-8fba-f16fbd121abd admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 May 23 15:33:37.587564 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 9/16] 10.222.0.64 () {54 vars in 930 bytes} [Mon May 23 15:33:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:33:37.649746 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-6714df1a-c506-44ba-b5e2-0a5870f48629 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "vcpus": 4, "name": "ds4G", "id": "d4", "os-flavor-access:is_public": true, "ram": 4096, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:33:37.759914 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-6714df1a-c506-44ba-b5e2-0a5870f48629 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.165799 May 23 15:33:37.761108 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 8/17] 10.222.0.64 () {64 vars in 1282 bytes} [Mon May 23 15:33:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 15:33:37.773235 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-27d6ca3a-9711-48b8-95f1-a8ff1063be5f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:33:37.912490 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-27d6ca3a-9711-48b8-95f1-a8ff1063be5f admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.142949 May 23 15:33:37.913511 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 10/18] 10.222.0.64 () {64 vars in 1335 bytes} [Mon May 23 15:33:37 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:33:40.227124 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-6714df1a-c506-44ba-b5e2-0a5870f48629 admin admin] Calling method '>' {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:40.228402 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-6714df1a-c506-44ba-b5e2-0a5870f48629 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001691 May 23 15:33:40.228795 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 9/19] 10.222.0.64 () {54 vars in 930 bytes} [Mon May 23 15:33:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:33:40.292066 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-5a26c946-21a6-4648-850e-ba60ee5ba089 admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:40.317398 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-5a26c946-21a6-4648-850e-ba60ee5ba089 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.081455 May 23 15:33:40.317931 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 11/20] 10.222.0.64 () {60 vars in 1291 bytes} [Mon May 23 15:33:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 15:33:42.723359 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-6714df1a-c506-44ba-b5e2-0a5870f48629 admin admin] Calling method '>' {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:42.724428 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-6714df1a-c506-44ba-b5e2-0a5870f48629 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 May 23 15:33:42.724858 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 10/21] 10.222.0.64 () {54 vars in 930 bytes} [Mon May 23 15:33:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:33:42.793051 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-eafe82a2-0462-4ed1-9738-0ffe489ece4a admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "id": "1", "vcpus": 1, "ram": 512, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:33:42.867918 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-eafe82a2-0462-4ed1-9738-0ffe489ece4a admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.136099 May 23 15:33:42.868476 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 12/22] 10.222.0.64 () {64 vars in 1282 bytes} [Mon May 23 15:33:42 2022] POST /compute/v2.1/flavors => generated 402 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 15:33:42.884417 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-7caa9431-ca5a-4dfd-9289-ae8979635b96 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:33:42.981679 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-7caa9431-ca5a-4dfd-9289-ae8979635b96 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.101000 May 23 15:33:42.982115 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 11/23] 10.222.0.64 () {64 vars in 1332 bytes} [Mon May 23 15:33:42 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:33:45.403531 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-eafe82a2-0462-4ed1-9738-0ffe489ece4a admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:45.404579 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-eafe82a2-0462-4ed1-9738-0ffe489ece4a admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001545 May 23 15:33:45.405043 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 13/24] 10.222.0.64 () {54 vars in 930 bytes} [Mon May 23 15:33:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:33:45.467888 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-97a926ca-560a-4b8a-92bf-66ba21b89f11 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "swap": 0, "vcpus": 1, "name": "m1.small", "id": "2", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:33:45.553710 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-97a926ca-560a-4b8a-92bf-66ba21b89f11 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.142493 May 23 15:33:45.554414 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 12/25] 10.222.0.64 () {64 vars in 1282 bytes} [Mon May 23 15:33:45 2022] POST /compute/v2.1/flavors => generated 405 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 15:33:45.567264 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-54b523e8-0f78-4f64-b4b8-cc4ec0f94fcf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:33:45.690087 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-54b523e8-0f78-4f64-b4b8-cc4ec0f94fcf admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.126513 May 23 15:33:45.690584 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 14/26] 10.222.0.64 () {64 vars in 1332 bytes} [Mon May 23 15:33:45 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:33:47.956644 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-97a926ca-560a-4b8a-92bf-66ba21b89f11 admin admin] Calling method '>' {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:47.957685 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-97a926ca-560a-4b8a-92bf-66ba21b89f11 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 May 23 15:33:47.958086 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 13/27] 10.222.0.64 () {54 vars in 930 bytes} [Mon May 23 15:33:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:33:48.015584 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-90162f1f-4f79-4df7-ad10-6c81fcb882f4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "disk": 40, "swap": 0, "ram": 4096, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 2, "os-flavor-access:is_public": true}} {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:33:48.088153 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-90162f1f-4f79-4df7-ad10-6c81fcb882f4 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.124069 May 23 15:33:48.088729 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 15/28] 10.222.0.64 () {64 vars in 1282 bytes} [Mon May 23 15:33:47 2022] POST /compute/v2.1/flavors => generated 406 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 15:33:48.101435 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-b938e63f-0f22-4736-9c2e-51960cde69bf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:33:48.215374 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-b938e63f-0f22-4736-9c2e-51960cde69bf admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.117516 May 23 15:33:48.215884 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 14/29] 10.222.0.64 () {64 vars in 1332 bytes} [Mon May 23 15:33:48 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:33:50.501026 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-90162f1f-4f79-4df7-ad10-6c81fcb882f4 admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:50.502065 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-90162f1f-4f79-4df7-ad10-6c81fcb882f4 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 May 23 15:33:50.502466 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 16/30] 10.222.0.64 () {54 vars in 930 bytes} [Mon May 23 15:33:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:33:50.562583 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-e687fa8e-a1a5-4015-b61f-827efde80cde admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "id": "4", "os-flavor-access:is_public": true, "ram": 8192, "rxtx_factor": 1.0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "swap": 0}} {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:33:50.654152 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-e687fa8e-a1a5-4015-b61f-827efde80cde admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.145320 May 23 15:33:50.654706 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 15/31] 10.222.0.64 () {64 vars in 1282 bytes} [Mon May 23 15:33:50 2022] POST /compute/v2.1/flavors => generated 405 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 15:33:50.667281 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-a3cb803c-82f1-43ee-94be-811c42df7c81 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:33:50.766442 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-a3cb803c-82f1-43ee-94be-811c42df7c81 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103398 May 23 15:33:50.767024 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 17/32] 10.222.0.64 () {64 vars in 1332 bytes} [Mon May 23 15:33:50 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:33:53.063823 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-e687fa8e-a1a5-4015-b61f-827efde80cde admin admin] Calling method '>' {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:33:53.064841 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-e687fa8e-a1a5-4015-b61f-827efde80cde admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 May 23 15:33:53.065497 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 16/33] 10.222.0.64 () {54 vars in 930 bytes} [Mon May 23 15:33:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:33:53.132488 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-47dc7f10-ff09-4c3c-b397-994a0df1c539 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "os-flavor-access:is_public": true, "id": "5", "rxtx_factor": 1.0, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 8, "disk": 160}} {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:33:53.214913 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-47dc7f10-ff09-4c3c-b397-994a0df1c539 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.140547 May 23 15:33:53.215475 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 18/34] 10.222.0.64 () {64 vars in 1282 bytes} [Mon May 23 15:33:53 2022] POST /compute/v2.1/flavors => generated 408 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 15:33:53.227644 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-7fd3f21c-7eba-4c07-bafa-c1613212613c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:33:53.331337 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-7fd3f21c-7eba-4c07-bafa-c1613212613c admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.107471 May 23 15:33:53.331920 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 17/35] 10.222.0.64 () {64 vars in 1332 bytes} [Mon May 23 15:33:53 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:34:17.630382 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-47dc7f10-ff09-4c3c-b397-994a0df1c539 admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:17.631442 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-47dc7f10-ff09-4c3c-b397-994a0df1c539 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 May 23 15:34:17.631835 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 19/36] 10.222.0.64 () {54 vars in 930 bytes} [Mon May 23 15:34:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:34:17.642964 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG dbcounter [-] [110435] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=110435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:34:17.692273 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-77ca8825-25dd-41ee-9ca1-8db9ffad5f98 admin admin] Calling method '>' {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:17.713506 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-77ca8825-25dd-41ee-9ca1-8db9ffad5f98 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.075054 May 23 15:34:17.714048 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 18/37] 10.222.0.64 () {60 vars in 1291 bytes} [Mon May 23 15:34:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:34:18.703392 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-47dc7f10-ff09-4c3c-b397-994a0df1c539 admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:18.704405 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-47dc7f10-ff09-4c3c-b397-994a0df1c539 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 May 23 15:34:18.704802 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 20/38] 10.222.0.64 () {56 vars in 1074 bytes} [Mon May 23 15:34:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:34:18.907325 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-b807919c-f6e4-424a-888c-22d0987c2933 admin admin] Calling method '>' {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:18.913441 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.wsgi [None req-b807919c-f6e4-424a-888c-22d0987c2933 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 23 15:34:18.917248 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-b807919c-f6e4-424a-888c-22d0987c2933 admin admin] Request method failure captured: May 23 15:34:18.917248 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 23 15:34:18.917248 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: Accept: application/json May 23 15:34:18.917248 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: Accept-Encoding: gzip, deflate May 23 15:34:18.917248 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: Connection: keep-alive May 23 15:34:18.917248 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: Content-Length: 0 May 23 15:34:18.917248 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: Host: 10.222.0.64 May 23 15:34:18.917248 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: Openstack-Api-Version: compute 2.90 May 23 15:34:18.917248 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: Openstack-System-Scope: None May 23 15:34:18.917248 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: User-Agent: python-novaclient May 23 15:34:18.917248 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: X-Auth-Token: gAAAAABii6l67sbSYYxBRXbEVipO2MU-rWG7RmLyOVM3VweJLC2XGiPV0ZkyNspa0ch1awsaVf1vShwJY_8Fz3BgZ011kgbdAnlTH0t4TrstqG_qo4RC3wjK3mM0nbZjM-RRYLmGkkLKFwXWJoKpKAcDKJ_zmMN41tQoE4459JPZCIwASyPfT6o May 23 15:34:18.917248 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: X-Domain-Id: None May 23 15:34:18.917248 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: X-Domain-Name: None May 23 15:34:18.917248 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: X-Identity-Status: Confirmed May 23 15:34:18.917248 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: X-Is-Admin-Project: True May 23 15:34:18.917248 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: X-Openstack-Nova-Api-Version: 2.90 May 23 15:34:18.917248 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: X-Project-Domain-Id: default May 23 15:34:18.917248 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: X-Project-Domain-Name: Default May 23 15:34:18.917248 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: X-Project-Id: 4c9cfa8acbce47f6b0259cbfbf5b338d May 23 15:34:18.917248 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: X-Project-Name: admin May 23 15:34:18.917248 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: X-Role: admin,reader,member May 23 15:34:18.917248 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: X-Roles: admin,reader,member May 23 15:34:18.918820 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4c9cfa8acbce47f6b0259cbfbf5b338d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/4c9cfa8acbce47f6b0259cbfbf5b338d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4c9cfa8acbce47f6b0259cbfbf5b338d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_4c9cfa8acbce47f6b0259cbfbf5b338d", "adminURL": "http://10.222.0.64:8080"}]}] May 23 15:34:18.918820 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: X-Tenant: admin May 23 15:34:18.918820 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: X-Tenant-Id: 4c9cfa8acbce47f6b0259cbfbf5b338d May 23 15:34:18.918820 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: X-Tenant-Name: admin May 23 15:34:18.918820 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: X-User: admin May 23 15:34:18.918820 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: X-User-Domain-Id: default May 23 15:34:18.918820 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: X-User-Domain-Name: Default May 23 15:34:18.918820 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: X-User-Id: 2781ce56481d4d179e62cc19ea41a8b0 May 23 15:34:18.918820 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: X-User-Name: admin May 23 15:34:18.918820 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: method: > May 23 15:34:18.918820 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: exception: Flavor 42 could not be found. May 23 15:34:18.918820 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: action_args: {'id': '42'} May 23 15:34:18.918820 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:34:18.918820 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:34:18.919782 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 23 15:34:18.919782 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 23 15:34:18.919782 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 23 15:34:18.919782 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 23 15:34:18.919782 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 23 15:34:18.919782 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 23 15:34:18.919782 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 23 15:34:18.919782 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 23 15:34:18.919782 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 23 15:34:18.919782 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:34:18.919782 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 23 15:34:18.919782 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 23 15:34:18.919782 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 23 15:34:18.919782 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi May 23 15:34:18.919782 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:34:18.919782 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi May 23 15:34:18.919782 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:34:18.919782 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:34:18.919782 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:34:18.921496 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:34:18.921496 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:34:18.921496 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:34:18.921496 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:34:18.921496 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 23 15:34:18.921496 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 23 15:34:18.921496 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 23 15:34:18.921496 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi May 23 15:34:18.921496 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:34:18.921496 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi May 23 15:34:18.921496 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:34:18.921496 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:34:18.921496 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:34:18.921496 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:34:18.921496 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:34:18.921496 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 23 15:34:18.921496 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi May 23 15:34:18.921496 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-b807919c-f6e4-424a-888c-22d0987c2933 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110435) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:34:18.922972 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-b807919c-f6e4-424a-888c-22d0987c2933 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062522 May 23 15:34:18.922972 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 19/39] 10.222.0.64 () {60 vars in 1190 bytes} [Mon May 23 15:34:18 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 23 15:34:18.928607 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-398897ef-49cd-4be6-ac9a-f869c7a34566 admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:18.932154 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG dbcounter [-] [110436] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=110436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:34:18.950513 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-398897ef-49cd-4be6-ac9a-f869c7a34566 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025744 May 23 15:34:18.951051 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 21/40] 10.222.0.64 () {60 vars in 1210 bytes} [Mon May 23 15:34:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:34:18.960440 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-30f90370-ddb7-47cd-a50e-af7afa32c468 admin admin] Calling method '>' {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:18.989290 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-30f90370-ddb7-47cd-a50e-af7afa32c468 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.032243 May 23 15:34:18.989849 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 20/41] 10.222.0.64 () {60 vars in 1210 bytes} [Mon May 23 15:34:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:34:18.999957 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-e7bd6133-65d6-4a5d-a7d0-fa9bd530ada5 admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:19.005646 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.wsgi [None req-e7bd6133-65d6-4a5d-a7d0-fa9bd530ada5 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 23 15:34:19.008898 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-e7bd6133-65d6-4a5d-a7d0-fa9bd530ada5 admin admin] Request method failure captured: May 23 15:34:19.008898 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 23 15:34:19.008898 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: Accept: application/json May 23 15:34:19.008898 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: Accept-Encoding: gzip, deflate May 23 15:34:19.008898 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: Connection: keep-alive May 23 15:34:19.008898 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: Content-Length: 0 May 23 15:34:19.008898 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: Host: 10.222.0.64 May 23 15:34:19.008898 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: Openstack-Api-Version: compute 2.90 May 23 15:34:19.008898 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: Openstack-System-Scope: None May 23 15:34:19.008898 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: User-Agent: python-novaclient May 23 15:34:19.008898 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: X-Auth-Token: gAAAAABii6l67sbSYYxBRXbEVipO2MU-rWG7RmLyOVM3VweJLC2XGiPV0ZkyNspa0ch1awsaVf1vShwJY_8Fz3BgZ011kgbdAnlTH0t4TrstqG_qo4RC3wjK3mM0nbZjM-RRYLmGkkLKFwXWJoKpKAcDKJ_zmMN41tQoE4459JPZCIwASyPfT6o May 23 15:34:19.008898 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: X-Domain-Id: None May 23 15:34:19.008898 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: X-Domain-Name: None May 23 15:34:19.008898 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: X-Identity-Status: Confirmed May 23 15:34:19.008898 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: X-Is-Admin-Project: True May 23 15:34:19.008898 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: X-Openstack-Nova-Api-Version: 2.90 May 23 15:34:19.008898 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: X-Project-Domain-Id: default May 23 15:34:19.008898 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: X-Project-Domain-Name: Default May 23 15:34:19.008898 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: X-Project-Id: 4c9cfa8acbce47f6b0259cbfbf5b338d May 23 15:34:19.008898 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: X-Project-Name: admin May 23 15:34:19.008898 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: X-Role: admin,reader,member May 23 15:34:19.008898 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: X-Roles: admin,reader,member May 23 15:34:19.010567 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4c9cfa8acbce47f6b0259cbfbf5b338d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/4c9cfa8acbce47f6b0259cbfbf5b338d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4c9cfa8acbce47f6b0259cbfbf5b338d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_4c9cfa8acbce47f6b0259cbfbf5b338d", "adminURL": "http://10.222.0.64:8080"}]}] May 23 15:34:19.010567 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: X-Tenant: admin May 23 15:34:19.010567 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: X-Tenant-Id: 4c9cfa8acbce47f6b0259cbfbf5b338d May 23 15:34:19.010567 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: X-Tenant-Name: admin May 23 15:34:19.010567 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: X-User: admin May 23 15:34:19.010567 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: X-User-Domain-Id: default May 23 15:34:19.010567 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: X-User-Domain-Name: Default May 23 15:34:19.010567 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: X-User-Id: 2781ce56481d4d179e62cc19ea41a8b0 May 23 15:34:19.010567 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: X-User-Name: admin May 23 15:34:19.010567 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: method: > May 23 15:34:19.010567 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: exception: Flavor 42 could not be found. May 23 15:34:19.010567 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: action_args: {'id': '42'} May 23 15:34:19.010567 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:34:19.010567 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:34:19.011728 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 23 15:34:19.011728 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 23 15:34:19.011728 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 23 15:34:19.011728 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 23 15:34:19.011728 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 23 15:34:19.011728 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 23 15:34:19.011728 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 23 15:34:19.011728 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 23 15:34:19.011728 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 23 15:34:19.011728 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:34:19.011728 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 23 15:34:19.011728 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 23 15:34:19.011728 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 23 15:34:19.011728 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi May 23 15:34:19.011728 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:34:19.011728 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi May 23 15:34:19.011728 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:34:19.011728 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:34:19.011728 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:34:19.013074 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:34:19.013074 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:34:19.013074 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:34:19.013074 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:34:19.013074 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 23 15:34:19.013074 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 23 15:34:19.013074 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 23 15:34:19.013074 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi May 23 15:34:19.013074 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:34:19.013074 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi May 23 15:34:19.013074 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:34:19.013074 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:34:19.013074 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:34:19.013074 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:34:19.013074 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:34:19.013074 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 23 15:34:19.013074 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi May 23 15:34:19.013074 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-e7bd6133-65d6-4a5d-a7d0-fa9bd530ada5 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110436) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:34:19.014369 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-e7bd6133-65d6-4a5d-a7d0-fa9bd530ada5 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.013955 May 23 15:34:19.014369 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 22/42] 10.222.0.64 () {60 vars in 1190 bytes} [Mon May 23 15:34:18 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 23 15:34:19.874257 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-30f90370-ddb7-47cd-a50e-af7afa32c468 admin admin] Calling method '>' {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:19.875325 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-30f90370-ddb7-47cd-a50e-af7afa32c468 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 May 23 15:34:19.875810 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 21/43] 10.222.0.64 () {56 vars in 1074 bytes} [Mon May 23 15:34:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:34:20.066439 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-c2c48737-dde7-46a8-a188-6823b486de83 admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:20.072293 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.wsgi [None req-c2c48737-dde7-46a8-a188-6823b486de83 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 23 15:34:20.073832 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-c2c48737-dde7-46a8-a188-6823b486de83 admin admin] Request method failure captured: May 23 15:34:20.073832 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 23 15:34:20.073832 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: Accept: application/json May 23 15:34:20.073832 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: Accept-Encoding: gzip, deflate May 23 15:34:20.073832 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: Connection: keep-alive May 23 15:34:20.073832 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: Content-Length: 0 May 23 15:34:20.073832 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: Host: 10.222.0.64 May 23 15:34:20.073832 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: Openstack-Api-Version: compute 2.90 May 23 15:34:20.073832 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: Openstack-System-Scope: None May 23 15:34:20.073832 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: User-Agent: python-novaclient May 23 15:34:20.073832 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: X-Auth-Token: gAAAAABii6l7wryCyX7PIDvmsGGDedTRAipNY8IRcmdC7GrAou8PQ25DQMVBPgM-yV8NEIg2wynkyOrLXCF4hFle6jTsm7d2ioadQc-LcK-tf84YxQ_pApZWQTxco5UD6jVWzi48ln7BqLTTsGsmt0Srdxio1kktwz_GnP3z88hdzooF9fVUsBk May 23 15:34:20.073832 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: X-Domain-Id: None May 23 15:34:20.073832 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: X-Domain-Name: None May 23 15:34:20.073832 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: X-Identity-Status: Confirmed May 23 15:34:20.073832 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: X-Is-Admin-Project: True May 23 15:34:20.073832 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: X-Openstack-Nova-Api-Version: 2.90 May 23 15:34:20.073832 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: X-Project-Domain-Id: default May 23 15:34:20.073832 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: X-Project-Domain-Name: Default May 23 15:34:20.073832 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: X-Project-Id: 4c9cfa8acbce47f6b0259cbfbf5b338d May 23 15:34:20.073832 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: X-Project-Name: admin May 23 15:34:20.073832 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: X-Role: admin,reader,member May 23 15:34:20.073832 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: X-Roles: admin,reader,member May 23 15:34:20.075390 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4c9cfa8acbce47f6b0259cbfbf5b338d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/4c9cfa8acbce47f6b0259cbfbf5b338d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4c9cfa8acbce47f6b0259cbfbf5b338d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_4c9cfa8acbce47f6b0259cbfbf5b338d", "adminURL": "http://10.222.0.64:8080"}]}] May 23 15:34:20.075390 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: X-Tenant: admin May 23 15:34:20.075390 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: X-Tenant-Id: 4c9cfa8acbce47f6b0259cbfbf5b338d May 23 15:34:20.075390 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: X-Tenant-Name: admin May 23 15:34:20.075390 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: X-User: admin May 23 15:34:20.075390 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: X-User-Domain-Id: default May 23 15:34:20.075390 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: X-User-Domain-Name: Default May 23 15:34:20.075390 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: X-User-Id: 2781ce56481d4d179e62cc19ea41a8b0 May 23 15:34:20.075390 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: X-User-Name: admin May 23 15:34:20.075390 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: method: > May 23 15:34:20.075390 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: exception: Flavor 84 could not be found. May 23 15:34:20.075390 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: action_args: {'id': '84'} May 23 15:34:20.075390 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:34:20.075390 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:34:20.076364 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 23 15:34:20.076364 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 23 15:34:20.076364 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 23 15:34:20.076364 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 23 15:34:20.076364 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 23 15:34:20.076364 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 23 15:34:20.076364 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 23 15:34:20.076364 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 23 15:34:20.076364 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 23 15:34:20.076364 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:34:20.076364 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 23 15:34:20.076364 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 23 15:34:20.076364 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 23 15:34:20.076364 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi May 23 15:34:20.076364 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:34:20.076364 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi May 23 15:34:20.076364 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:34:20.076364 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:34:20.076364 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:34:20.077767 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:34:20.077767 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:34:20.077767 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:34:20.077767 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:34:20.077767 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 23 15:34:20.077767 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 23 15:34:20.077767 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 23 15:34:20.077767 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi May 23 15:34:20.077767 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:34:20.077767 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi May 23 15:34:20.077767 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:34:20.077767 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:34:20.077767 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:34:20.077767 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:34:20.077767 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:34:20.077767 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 23 15:34:20.077767 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi May 23 15:34:20.077767 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-c2c48737-dde7-46a8-a188-6823b486de83 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110436) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:34:20.079081 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-c2c48737-dde7-46a8-a188-6823b486de83 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.061733 May 23 15:34:20.079081 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 23/44] 10.222.0.64 () {60 vars in 1190 bytes} [Mon May 23 15:34:20 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 23 15:34:20.085257 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-01142ca0-48ec-4f66-87b0-8319d4a9624e admin admin] Calling method '>' {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:20.100911 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-01142ca0-48ec-4f66-87b0-8319d4a9624e admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019360 May 23 15:34:20.101521 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 22/45] 10.222.0.64 () {60 vars in 1210 bytes} [Mon May 23 15:34:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 15:34:20.111770 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-62c43c14-775d-4a89-8757-141594e7bfca admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:20.127025 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-62c43c14-775d-4a89-8757-141594e7bfca admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019158 May 23 15:34:20.127565 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 24/46] 10.222.0.64 () {60 vars in 1210 bytes} [Mon May 23 15:34:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 15:34:20.137634 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-f77d9360-09ba-403a-b3ee-6335f09cf15c admin admin] Calling method '>' {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:20.142996 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.wsgi [None req-f77d9360-09ba-403a-b3ee-6335f09cf15c admin admin] HTTP exception thrown: Flavor 84 could not be found. May 23 15:34:20.150157 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-f77d9360-09ba-403a-b3ee-6335f09cf15c admin admin] Request method failure captured: May 23 15:34:20.150157 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 23 15:34:20.150157 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: Accept: application/json May 23 15:34:20.150157 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: Accept-Encoding: gzip, deflate May 23 15:34:20.150157 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: Connection: keep-alive May 23 15:34:20.150157 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: Content-Length: 0 May 23 15:34:20.150157 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: Host: 10.222.0.64 May 23 15:34:20.150157 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: Openstack-Api-Version: compute 2.90 May 23 15:34:20.150157 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: Openstack-System-Scope: None May 23 15:34:20.150157 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: User-Agent: python-novaclient May 23 15:34:20.150157 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: X-Auth-Token: gAAAAABii6l7wryCyX7PIDvmsGGDedTRAipNY8IRcmdC7GrAou8PQ25DQMVBPgM-yV8NEIg2wynkyOrLXCF4hFle6jTsm7d2ioadQc-LcK-tf84YxQ_pApZWQTxco5UD6jVWzi48ln7BqLTTsGsmt0Srdxio1kktwz_GnP3z88hdzooF9fVUsBk May 23 15:34:20.150157 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: X-Domain-Id: None May 23 15:34:20.150157 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: X-Domain-Name: None May 23 15:34:20.150157 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: X-Identity-Status: Confirmed May 23 15:34:20.150157 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: X-Is-Admin-Project: True May 23 15:34:20.150157 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: X-Openstack-Nova-Api-Version: 2.90 May 23 15:34:20.150157 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: X-Project-Domain-Id: default May 23 15:34:20.150157 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: X-Project-Domain-Name: Default May 23 15:34:20.150157 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: X-Project-Id: 4c9cfa8acbce47f6b0259cbfbf5b338d May 23 15:34:20.150157 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: X-Project-Name: admin May 23 15:34:20.150157 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: X-Role: admin,reader,member May 23 15:34:20.150157 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: X-Roles: admin,reader,member May 23 15:34:20.151832 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4c9cfa8acbce47f6b0259cbfbf5b338d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/4c9cfa8acbce47f6b0259cbfbf5b338d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4c9cfa8acbce47f6b0259cbfbf5b338d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_4c9cfa8acbce47f6b0259cbfbf5b338d", "adminURL": "http://10.222.0.64:8080"}]}] May 23 15:34:20.151832 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: X-Tenant: admin May 23 15:34:20.151832 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: X-Tenant-Id: 4c9cfa8acbce47f6b0259cbfbf5b338d May 23 15:34:20.151832 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: X-Tenant-Name: admin May 23 15:34:20.151832 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: X-User: admin May 23 15:34:20.151832 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: X-User-Domain-Id: default May 23 15:34:20.151832 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: X-User-Domain-Name: Default May 23 15:34:20.151832 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: X-User-Id: 2781ce56481d4d179e62cc19ea41a8b0 May 23 15:34:20.151832 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: X-User-Name: admin May 23 15:34:20.151832 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: method: > May 23 15:34:20.151832 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: exception: Flavor 84 could not be found. May 23 15:34:20.151832 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: action_args: {'id': '84'} May 23 15:34:20.151832 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:34:20.151832 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:34:20.152846 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 23 15:34:20.152846 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 23 15:34:20.152846 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 23 15:34:20.152846 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 23 15:34:20.152846 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 23 15:34:20.152846 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 23 15:34:20.152846 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 23 15:34:20.152846 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 23 15:34:20.152846 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 23 15:34:20.152846 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:34:20.152846 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 23 15:34:20.152846 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 23 15:34:20.152846 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 23 15:34:20.152846 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi May 23 15:34:20.152846 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:34:20.152846 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi May 23 15:34:20.152846 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:34:20.152846 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:34:20.152846 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:34:20.154237 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:34:20.154237 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:34:20.154237 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:34:20.154237 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:34:20.154237 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 23 15:34:20.154237 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 23 15:34:20.154237 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 23 15:34:20.154237 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi May 23 15:34:20.154237 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:34:20.154237 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi May 23 15:34:20.154237 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:34:20.154237 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:34:20.154237 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:34:20.154237 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:34:20.154237 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:34:20.154237 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 23 15:34:20.154237 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi May 23 15:34:20.154237 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-f77d9360-09ba-403a-b3ee-6335f09cf15c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110435) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:34:20.155530 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-f77d9360-09ba-403a-b3ee-6335f09cf15c admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012476 May 23 15:34:20.155530 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 23/47] 10.222.0.64 () {60 vars in 1190 bytes} [Mon May 23 15:34:20 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 23 15:34:21.011954 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-62c43c14-775d-4a89-8757-141594e7bfca admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:21.012989 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-62c43c14-775d-4a89-8757-141594e7bfca admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 May 23 15:34:21.013425 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 25/48] 10.222.0.64 () {56 vars in 1074 bytes} [Mon May 23 15:34:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:34:21.203612 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-187fefdb-cc79-4e76-a5a3-4a93b6108d34 admin admin] Calling method '>' {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:21.208909 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.wsgi [None req-187fefdb-cc79-4e76-a5a3-4a93b6108d34 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 23 15:34:21.210429 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-187fefdb-cc79-4e76-a5a3-4a93b6108d34 admin admin] Request method failure captured: May 23 15:34:21.210429 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 23 15:34:21.210429 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: Accept: application/json May 23 15:34:21.210429 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: Accept-Encoding: gzip, deflate May 23 15:34:21.210429 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: Connection: keep-alive May 23 15:34:21.210429 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: Content-Length: 0 May 23 15:34:21.210429 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: Host: 10.222.0.64 May 23 15:34:21.210429 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: Openstack-Api-Version: compute 2.90 May 23 15:34:21.210429 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: Openstack-System-Scope: None May 23 15:34:21.210429 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: User-Agent: python-novaclient May 23 15:34:21.210429 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: X-Auth-Token: gAAAAABii6l8lKEgdfdLMpTSPXErHTjqFXwg0FVm8ADjPUDCBBDVA8BGliLVhfXob5Ma_1BCmZ9GAc4WFqZfO1VKebARkvKBd6xMLAx-T4oOl57zhNCR-s-rr1pKOK0-9UI4UuCL8q3g22QlM8n6ifJWmd0tTCSfA81uI82kvRonjEYgAeAulZw May 23 15:34:21.210429 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: X-Domain-Id: None May 23 15:34:21.210429 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: X-Domain-Name: None May 23 15:34:21.210429 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: X-Identity-Status: Confirmed May 23 15:34:21.210429 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: X-Is-Admin-Project: True May 23 15:34:21.210429 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: X-Openstack-Nova-Api-Version: 2.90 May 23 15:34:21.210429 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: X-Project-Domain-Id: default May 23 15:34:21.210429 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: X-Project-Domain-Name: Default May 23 15:34:21.210429 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: X-Project-Id: 4c9cfa8acbce47f6b0259cbfbf5b338d May 23 15:34:21.210429 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: X-Project-Name: admin May 23 15:34:21.210429 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: X-Role: admin,reader,member May 23 15:34:21.210429 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: X-Roles: admin,reader,member May 23 15:34:21.212021 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4c9cfa8acbce47f6b0259cbfbf5b338d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/4c9cfa8acbce47f6b0259cbfbf5b338d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4c9cfa8acbce47f6b0259cbfbf5b338d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_4c9cfa8acbce47f6b0259cbfbf5b338d", "adminURL": "http://10.222.0.64:8080"}]}] May 23 15:34:21.212021 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: X-Tenant: admin May 23 15:34:21.212021 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: X-Tenant-Id: 4c9cfa8acbce47f6b0259cbfbf5b338d May 23 15:34:21.212021 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: X-Tenant-Name: admin May 23 15:34:21.212021 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: X-User: admin May 23 15:34:21.212021 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: X-User-Domain-Id: default May 23 15:34:21.212021 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: X-User-Domain-Name: Default May 23 15:34:21.212021 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: X-User-Id: 2781ce56481d4d179e62cc19ea41a8b0 May 23 15:34:21.212021 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: X-User-Name: admin May 23 15:34:21.212021 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: method: > May 23 15:34:21.212021 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: exception: Flavor 451 could not be found. May 23 15:34:21.212021 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: action_args: {'id': '451'} May 23 15:34:21.212021 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:34:21.212021 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:34:21.213032 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 23 15:34:21.213032 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 23 15:34:21.213032 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 23 15:34:21.213032 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 23 15:34:21.213032 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 23 15:34:21.213032 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 23 15:34:21.213032 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 23 15:34:21.213032 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 23 15:34:21.213032 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 23 15:34:21.213032 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:34:21.213032 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 23 15:34:21.213032 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 23 15:34:21.213032 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 23 15:34:21.213032 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi May 23 15:34:21.213032 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:34:21.213032 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi May 23 15:34:21.213032 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:34:21.213032 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:34:21.213032 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:34:21.214418 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:34:21.214418 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:34:21.214418 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:34:21.214418 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:34:21.214418 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 23 15:34:21.214418 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 23 15:34:21.214418 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 23 15:34:21.214418 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi May 23 15:34:21.214418 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:34:21.214418 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi May 23 15:34:21.214418 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:34:21.214418 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:34:21.214418 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:34:21.214418 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:34:21.214418 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:34:21.214418 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 23 15:34:21.214418 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: ERROR nova.api.openstack.wsgi May 23 15:34:21.214418 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-187fefdb-cc79-4e76-a5a3-4a93b6108d34 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110435) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:34:21.215733 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-187fefdb-cc79-4e76-a5a3-4a93b6108d34 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.061033 May 23 15:34:21.215733 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 24/49] 10.222.0.64 () {60 vars in 1193 bytes} [Mon May 23 15:34:21 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 23 15:34:21.221737 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-49d5a3b4-5edb-4cfb-93c6-a8b5e0b86819 admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:21.237244 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-49d5a3b4-5edb-4cfb-93c6-a8b5e0b86819 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019064 May 23 15:34:21.237768 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 26/50] 10.222.0.64 () {60 vars in 1210 bytes} [Mon May 23 15:34:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:34:21.248403 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-241eac9e-f2a5-472b-8ec6-29682e7fc585 admin admin] Calling method '>' {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:21.261715 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-241eac9e-f2a5-472b-8ec6-29682e7fc585 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017307 May 23 15:34:21.262253 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 25/51] 10.222.0.64 () {60 vars in 1210 bytes} [Mon May 23 15:34:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 15:34:21.271448 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-b40c9432-485b-4cde-86a1-2a88b6b62c38 admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:21.276905 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.wsgi [None req-b40c9432-485b-4cde-86a1-2a88b6b62c38 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 23 15:34:21.278408 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-b40c9432-485b-4cde-86a1-2a88b6b62c38 admin admin] Request method failure captured: May 23 15:34:21.278408 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 23 15:34:21.278408 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: Accept: application/json May 23 15:34:21.278408 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: Accept-Encoding: gzip, deflate May 23 15:34:21.278408 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: Connection: keep-alive May 23 15:34:21.278408 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: Content-Length: 0 May 23 15:34:21.278408 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: Host: 10.222.0.64 May 23 15:34:21.278408 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: Openstack-Api-Version: compute 2.90 May 23 15:34:21.278408 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: Openstack-System-Scope: None May 23 15:34:21.278408 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: User-Agent: python-novaclient May 23 15:34:21.278408 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: X-Auth-Token: gAAAAABii6l8lKEgdfdLMpTSPXErHTjqFXwg0FVm8ADjPUDCBBDVA8BGliLVhfXob5Ma_1BCmZ9GAc4WFqZfO1VKebARkvKBd6xMLAx-T4oOl57zhNCR-s-rr1pKOK0-9UI4UuCL8q3g22QlM8n6ifJWmd0tTCSfA81uI82kvRonjEYgAeAulZw May 23 15:34:21.278408 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: X-Domain-Id: None May 23 15:34:21.278408 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: X-Domain-Name: None May 23 15:34:21.278408 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: X-Identity-Status: Confirmed May 23 15:34:21.278408 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: X-Is-Admin-Project: True May 23 15:34:21.278408 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: X-Openstack-Nova-Api-Version: 2.90 May 23 15:34:21.278408 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: X-Project-Domain-Id: default May 23 15:34:21.278408 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: X-Project-Domain-Name: Default May 23 15:34:21.278408 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: X-Project-Id: 4c9cfa8acbce47f6b0259cbfbf5b338d May 23 15:34:21.278408 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: X-Project-Name: admin May 23 15:34:21.278408 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: X-Role: admin,reader,member May 23 15:34:21.278408 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: X-Roles: admin,reader,member May 23 15:34:21.279988 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4c9cfa8acbce47f6b0259cbfbf5b338d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/4c9cfa8acbce47f6b0259cbfbf5b338d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4c9cfa8acbce47f6b0259cbfbf5b338d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_4c9cfa8acbce47f6b0259cbfbf5b338d", "adminURL": "http://10.222.0.64:8080"}]}] May 23 15:34:21.279988 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: X-Tenant: admin May 23 15:34:21.279988 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: X-Tenant-Id: 4c9cfa8acbce47f6b0259cbfbf5b338d May 23 15:34:21.279988 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: X-Tenant-Name: admin May 23 15:34:21.279988 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: X-User: admin May 23 15:34:21.279988 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: X-User-Domain-Id: default May 23 15:34:21.279988 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: X-User-Domain-Name: Default May 23 15:34:21.279988 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: X-User-Id: 2781ce56481d4d179e62cc19ea41a8b0 May 23 15:34:21.279988 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: X-User-Name: admin May 23 15:34:21.279988 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: method: > May 23 15:34:21.279988 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: exception: Flavor 451 could not be found. May 23 15:34:21.279988 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: action_args: {'id': '451'} May 23 15:34:21.279988 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:34:21.279988 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:34:21.280976 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 23 15:34:21.280976 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 23 15:34:21.280976 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 23 15:34:21.280976 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 23 15:34:21.280976 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 23 15:34:21.280976 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 23 15:34:21.280976 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 23 15:34:21.280976 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 23 15:34:21.280976 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 23 15:34:21.280976 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:34:21.280976 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 23 15:34:21.280976 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 23 15:34:21.280976 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 23 15:34:21.280976 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi May 23 15:34:21.280976 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:34:21.280976 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi May 23 15:34:21.280976 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:34:21.280976 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:34:21.280976 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:34:21.282331 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:34:21.282331 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:34:21.282331 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:34:21.282331 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:34:21.282331 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 23 15:34:21.282331 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 23 15:34:21.282331 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 23 15:34:21.282331 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi May 23 15:34:21.282331 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:34:21.282331 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi May 23 15:34:21.282331 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:34:21.282331 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:34:21.282331 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:34:21.282331 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:34:21.282331 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:34:21.282331 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 23 15:34:21.282331 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: ERROR nova.api.openstack.wsgi May 23 15:34:21.282331 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-b40c9432-485b-4cde-86a1-2a88b6b62c38 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110436) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:34:21.283610 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-b40c9432-485b-4cde-86a1-2a88b6b62c38 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011838 May 23 15:34:21.283610 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 27/52] 10.222.0.64 () {60 vars in 1193 bytes} [Mon May 23 15:34:21 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 23 15:34:22.149679 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-241eac9e-f2a5-472b-8ec6-29682e7fc585 admin admin] Calling method '>' {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:22.150655 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-241eac9e-f2a5-472b-8ec6-29682e7fc585 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002083 May 23 15:34:22.151052 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 26/53] 10.222.0.64 () {56 vars in 1074 bytes} [Mon May 23 15:34:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:34:22.340910 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-42dfe419-a37f-460d-8958-560b6fc79441 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:34:22.421746 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-42dfe419-a37f-460d-8958-560b6fc79441 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.132843 May 23 15:34:22.422211 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 28/54] 10.222.0.64 () {64 vars in 1235 bytes} [Mon May 23 15:34:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 15:34:23.287294 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-241eac9e-f2a5-472b-8ec6-29682e7fc585 admin admin] Calling method '>' {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:23.288309 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-241eac9e-f2a5-472b-8ec6-29682e7fc585 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 May 23 15:34:23.288711 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 27/55] 10.222.0.64 () {56 vars in 1074 bytes} [Mon May 23 15:34:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:34:23.479599 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-c3a8f33d-7dee-4cec-aa7f-9b0390d0642f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:34:23.568922 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-c3a8f33d-7dee-4cec-aa7f-9b0390d0642f admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.140518 May 23 15:34:23.569500 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 29/56] 10.222.0.64 () {64 vars in 1235 bytes} [Mon May 23 15:34:23 2022] POST /compute/v2.1/flavors => generated 405 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 15:34:24.435485 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-241eac9e-f2a5-472b-8ec6-29682e7fc585 admin admin] Calling method '>' {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:24.436492 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-241eac9e-f2a5-472b-8ec6-29682e7fc585 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 May 23 15:34:24.436891 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 28/57] 10.222.0.64 () {56 vars in 1074 bytes} [Mon May 23 15:34:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:34:24.626038 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-83e829be-46d1-4ee2-930b-4aee240bd270 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:34:24.723545 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-83e829be-46d1-4ee2-930b-4aee240bd270 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.148818 May 23 15:34:24.724098 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 30/58] 10.222.0.64 () {64 vars in 1235 bytes} [Mon May 23 15:34:24 2022] POST /compute/v2.1/flavors => generated 407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 15:34:25.589212 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-241eac9e-f2a5-472b-8ec6-29682e7fc585 admin admin] Calling method '>' {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:25.590215 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-241eac9e-f2a5-472b-8ec6-29682e7fc585 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 May 23 15:34:25.590611 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 29/59] 10.222.0.64 () {56 vars in 1074 bytes} [Mon May 23 15:34:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:34:25.783476 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-318054fe-7595-4213-ada4-3f00442243ea admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:34:25.924233 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-318054fe-7595-4213-ada4-3f00442243ea admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.193419 May 23 15:34:25.924704 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 31/60] 10.222.0.64 () {64 vars in 1235 bytes} [Mon May 23 15:34:25 2022] POST /compute/v2.1/flavors => generated 409 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 15:34:26.787425 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-241eac9e-f2a5-472b-8ec6-29682e7fc585 admin admin] Calling method '>' {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:26.788418 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-241eac9e-f2a5-472b-8ec6-29682e7fc585 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 May 23 15:34:26.788806 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 30/61] 10.222.0.64 () {56 vars in 1074 bytes} [Mon May 23 15:34:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:34:26.975723 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-4ad43938-e27a-4b1f-ad0d-e1bb1df1f163 admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:34:26.995646 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-4ad43938-e27a-4b1f-ad0d-e1bb1df1f163 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.071629 May 23 15:34:26.996173 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 32/62] 10.222.0.64 () {60 vars in 1202 bytes} [Mon May 23 15:34:26 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:35:29.000993 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-241eac9e-f2a5-472b-8ec6-29682e7fc585 admin admin] Calling method '>' {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:29.002024 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-241eac9e-f2a5-472b-8ec6-29682e7fc585 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 May 23 15:35:29.002410 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 31/63] 10.222.0.64 () {54 vars in 930 bytes} [Mon May 23 15:35:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:35:29.010704 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG dbcounter [-] [110436] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=110436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:29.062885 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-8562b1f9-a9d9-4635-92b8-e7c74b96940a admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:29.092154 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-8562b1f9-a9d9-4635-92b8-e7c74b96940a admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.083039 May 23 15:35:29.093265 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 33/64] 10.222.0.64 () {60 vars in 1291 bytes} [Mon May 23 15:35:29 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:35:29.117488 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG dbcounter [-] [110435] Writing DB stats nova_api:SELECT=14 {{(pid=110435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:35:29.121408 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-f5c7583d-eca1-455d-9a40-7bf1e0b6b6b6 admin admin] Calling method '>' {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:29.129148 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-f5c7583d-eca1-455d-9a40-7bf1e0b6b6b6 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013071 May 23 15:35:29.130504 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 32/65] 10.222.0.64 () {60 vars in 1282 bytes} [Mon May 23 15:35:29 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:35:29.142213 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-c0437448-7c95-4aa7-a74a-1fdc37d8e37a admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:29.150107 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-c0437448-7c95-4aa7-a74a-1fdc37d8e37a admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011565 May 23 15:35:29.150631 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 34/66] 10.222.0.64 () {60 vars in 1285 bytes} [Mon May 23 15:35:29 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:35:29.162275 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-bffe0e03-0cbb-409c-a0a4-6c0df17f15c3 admin admin] Calling method '>' {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:29.169930 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-bffe0e03-0cbb-409c-a0a4-6c0df17f15c3 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011643 May 23 15:35:29.170450 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 33/67] 10.222.0.64 () {60 vars in 1285 bytes} [Mon May 23 15:35:29 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:35:29.183753 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-05aba2d4-e7e2-468d-8f5a-54b067b54df9 admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:35:29.191310 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-05aba2d4-e7e2-468d-8f5a-54b067b54df9 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011125 May 23 15:35:29.191857 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 35/68] 10.222.0.64 () {60 vars in 1282 bytes} [Mon May 23 15:35:29 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:39:19.296176 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-bffe0e03-0cbb-409c-a0a4-6c0df17f15c3 admin admin] Calling method '>' {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:39:19.297223 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-bffe0e03-0cbb-409c-a0a4-6c0df17f15c3 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001697 May 23 15:39:19.297623 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 34/69] 10.222.0.64 () {56 vars in 1074 bytes} [Mon May 23 15:39:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:39:19.457038 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG dbcounter [-] [110436] Writing DB stats nova_api:SELECT=6 {{(pid=110436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:19.572923 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-292ad7bb-88fa-420e-ae2a-4f77be805cdd admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:39:19.574151 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 15:39:19.574151 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: warnings.warn(msg) May 23 15:39:19.575355 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG oslo_concurrency.lockutils [None req-292ad7bb-88fa-420e-ae2a-4f77be805cdd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:39:19.575795 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG oslo_concurrency.lockutils [None req-292ad7bb-88fa-420e-ae2a-4f77be805cdd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:39:19.576613 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG oslo_concurrency.lockutils [None req-292ad7bb-88fa-420e-ae2a-4f77be805cdd admin admin] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:39:19.577041 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG oslo_concurrency.lockutils [None req-292ad7bb-88fa-420e-ae2a-4f77be805cdd admin admin] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:39:19.610642 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-292ad7bb-88fa-420e-ae2a-4f77be805cdd admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.155008 May 23 15:39:19.611195 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 36/70] 10.222.0.64 () {60 vars in 1193 bytes} [Mon May 23 15:39:19 2022] GET /compute/v2.1/os-services => generated 794 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 15:39:20.477194 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-bffe0e03-0cbb-409c-a0a4-6c0df17f15c3 admin admin] Calling method '>' {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:39:20.478205 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-bffe0e03-0cbb-409c-a0a4-6c0df17f15c3 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 May 23 15:39:20.478611 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 35/71] 10.222.0.64 () {56 vars in 1074 bytes} [Mon May 23 15:39:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:39:20.666799 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-051da675-6ff2-4567-bb04-538510078c3c admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:39:20.668026 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 15:39:20.668026 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: warnings.warn(msg) May 23 15:39:20.669242 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG oslo_concurrency.lockutils [None req-051da675-6ff2-4567-bb04-538510078c3c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:39:20.669682 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG oslo_concurrency.lockutils [None req-051da675-6ff2-4567-bb04-538510078c3c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:39:20.670719 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG oslo_concurrency.lockutils [None req-051da675-6ff2-4567-bb04-538510078c3c admin admin] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:39:20.671140 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG oslo_concurrency.lockutils [None req-051da675-6ff2-4567-bb04-538510078c3c admin admin] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:39:20.690855 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-051da675-6ff2-4567-bb04-538510078c3c admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.075268 May 23 15:39:20.691332 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 37/72] 10.222.0.64 () {60 vars in 1193 bytes} [Mon May 23 15:39:20 2022] GET /compute/v2.1/os-services => generated 794 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 15:39:31.989619 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-bffe0e03-0cbb-409c-a0a4-6c0df17f15c3 admin admin] Calling method '>' {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:39:31.990628 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-bffe0e03-0cbb-409c-a0a4-6c0df17f15c3 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 May 23 15:39:31.991042 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 36/73] 10.222.0.64 () {56 vars in 1074 bytes} [Mon May 23 15:39:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:39:32.138608 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG dbcounter [-] [110436] Writing DB stats nova_cell0:SELECT=4 {{(pid=110436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:32.139743 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG dbcounter [-] [110436] Writing DB stats nova_cell1:SELECT=4 {{(pid=110436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:32.140389 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG dbcounter [-] [110436] Writing DB stats nova_api:SELECT=8 {{(pid=110436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:32.191189 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-2c8d669f-2f37-4668-9851-45ac55a3f0f3 admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:39:32.192396 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 15:39:32.192396 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: warnings.warn(msg) May 23 15:39:32.194389 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG oslo_concurrency.lockutils [None req-2c8d669f-2f37-4668-9851-45ac55a3f0f3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:39:32.195237 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG oslo_concurrency.lockutils [None req-2c8d669f-2f37-4668-9851-45ac55a3f0f3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:39:32.196014 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG oslo_concurrency.lockutils [None req-2c8d669f-2f37-4668-9851-45ac55a3f0f3 admin admin] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:39:32.196435 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG oslo_concurrency.lockutils [None req-2c8d669f-2f37-4668-9851-45ac55a3f0f3 admin admin] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:39:32.220074 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-2c8d669f-2f37-4668-9851-45ac55a3f0f3 admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.083865 May 23 15:39:32.220074 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 38/74] 10.222.0.64 () {60 vars in 1193 bytes} [Mon May 23 15:39:32 2022] GET /compute/v2.1/os-services => generated 794 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 15:39:33.127002 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-bffe0e03-0cbb-409c-a0a4-6c0df17f15c3 admin admin] Calling method '>' {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:39:33.128020 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-bffe0e03-0cbb-409c-a0a4-6c0df17f15c3 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 May 23 15:39:33.128418 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 37/75] 10.222.0.64 () {56 vars in 1074 bytes} [Mon May 23 15:39:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:39:33.318859 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-f9baafa5-4f09-49d9-83e0-54a03e59b852 admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:39:33.320039 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 15:39:33.320039 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: warnings.warn(msg) May 23 15:39:33.321360 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG oslo_concurrency.lockutils [None req-f9baafa5-4f09-49d9-83e0-54a03e59b852 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:39:33.321803 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG oslo_concurrency.lockutils [None req-f9baafa5-4f09-49d9-83e0-54a03e59b852 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:39:33.322603 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG oslo_concurrency.lockutils [None req-f9baafa5-4f09-49d9-83e0-54a03e59b852 admin admin] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:39:33.323057 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG oslo_concurrency.lockutils [None req-f9baafa5-4f09-49d9-83e0-54a03e59b852 admin admin] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:39:33.349334 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-f9baafa5-4f09-49d9-83e0-54a03e59b852 admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.081634 May 23 15:39:33.349886 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 39/76] 10.222.0.64 () {60 vars in 1193 bytes} [Mon May 23 15:39:33 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:39:44.650700 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-bffe0e03-0cbb-409c-a0a4-6c0df17f15c3 admin admin] Calling method '>' {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:39:44.651744 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-bffe0e03-0cbb-409c-a0a4-6c0df17f15c3 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 May 23 15:39:44.652145 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 38/77] 10.222.0.64 () {56 vars in 1074 bytes} [Mon May 23 15:39:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:39:44.801378 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG dbcounter [-] [110436] Writing DB stats nova_cell0:SELECT=4 {{(pid=110436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:44.802073 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG dbcounter [-] [110436] Writing DB stats nova_cell1:SELECT=4 {{(pid=110436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:44.802684 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG dbcounter [-] [110436] Writing DB stats nova_api:SELECT=8 {{(pid=110436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:39:44.850831 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-adf9bcaf-3888-4580-b7a0-b866915d2239 admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:39:44.852150 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 15:39:44.852150 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: warnings.warn(msg) May 23 15:39:44.853365 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG oslo_concurrency.lockutils [None req-adf9bcaf-3888-4580-b7a0-b866915d2239 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:39:44.885235 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG oslo_concurrency.lockutils [None req-adf9bcaf-3888-4580-b7a0-b866915d2239 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:39:44.885235 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG oslo_concurrency.lockutils [None req-adf9bcaf-3888-4580-b7a0-b866915d2239 admin admin] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:39:44.885235 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG oslo_concurrency.lockutils [None req-adf9bcaf-3888-4580-b7a0-b866915d2239 admin admin] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:39:44.885235 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-adf9bcaf-3888-4580-b7a0-b866915d2239 admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.079081 May 23 15:39:44.885235 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 40/78] 10.222.0.64 () {60 vars in 1193 bytes} [Mon May 23 15:39:44 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:39:45.773152 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: DEBUG nova.api.openstack.wsgi [None req-bffe0e03-0cbb-409c-a0a4-6c0df17f15c3 admin admin] Calling method '>' {{(pid=110435) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:39:45.774222 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: INFO nova.api.openstack.requestlog [None req-bffe0e03-0cbb-409c-a0a4-6c0df17f15c3 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 May 23 15:39:45.779370 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: [pid: 110435|app: 0|req: 39/79] 10.222.0.64 () {56 vars in 1074 bytes} [Mon May 23 15:39:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:39:45.970567 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG nova.api.openstack.wsgi [None req-f0484fa3-714d-4730-bfc9-087ad82bffc6 admin admin] Calling method '>' {{(pid=110436) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:39:45.971842 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 15:39:45.971842 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: warnings.warn(msg) May 23 15:39:45.973120 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG oslo_concurrency.lockutils [None req-f0484fa3-714d-4730-bfc9-087ad82bffc6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:39:45.973574 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG oslo_concurrency.lockutils [None req-f0484fa3-714d-4730-bfc9-087ad82bffc6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:39:45.974408 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG oslo_concurrency.lockutils [None req-f0484fa3-714d-4730-bfc9-087ad82bffc6 admin admin] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:39:45.974868 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: DEBUG oslo_concurrency.lockutils [None req-f0484fa3-714d-4730-bfc9-087ad82bffc6 admin admin] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110436) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:39:45.997181 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: INFO nova.api.openstack.requestlog [None req-f0484fa3-714d-4730-bfc9-087ad82bffc6 admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.079805 May 23 15:39:45.997946 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: [pid: 110436|app: 0|req: 41/80] 10.222.0.64 () {60 vars in 1193 bytes} [Mon May 23 15:39:45 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:40:43.462938 dv-cinder-840678-12-iscsi devstack@n-api.service[110434]: Mon May 23 15:40:43 2022 - graceful shutdown triggered... May 23 15:40:43.463475 dv-cinder-840678-12-iscsi devstack@n-api.service[110436]: Gracefully killing worker 2 (pid: 110436)... May 23 15:40:43.463858 dv-cinder-840678-12-iscsi devstack@n-api.service[110435]: Gracefully killing worker 1 (pid: 110435)... May 23 15:40:43.464733 dv-cinder-840678-12-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 23 15:40:44.464013 dv-cinder-840678-12-iscsi devstack@n-api.service[110434]: worker 1 buried after 1 seconds May 23 15:40:44.464013 dv-cinder-840678-12-iscsi devstack@n-api.service[110434]: worker 2 buried after 1 seconds May 23 15:40:44.464013 dv-cinder-840678-12-iscsi devstack@n-api.service[110434]: goodbye to uWSGI. May 23 15:40:44.465548 dv-cinder-840678-12-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 23 15:40:44.466139 dv-cinder-840678-12-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 23 15:40:44.468919 dv-cinder-840678-12-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 23 15:40:44.484358 dv-cinder-840678-12-iscsi devstack@n-api.service[124917]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 23 15:40:44.511605 dv-cinder-840678-12-iscsi devstack@n-api.service[124917]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 23 15:40:44 2022] *** May 23 15:40:44.511605 dv-cinder-840678-12-iscsi devstack@n-api.service[124917]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 23 15:40:44.511605 dv-cinder-840678-12-iscsi devstack@n-api.service[124917]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 23 15:40:44.511605 dv-cinder-840678-12-iscsi devstack@n-api.service[124917]: nodename: dv-cinder-840678-12-iscsi May 23 15:40:44.511605 dv-cinder-840678-12-iscsi devstack@n-api.service[124917]: machine: x86_64 May 23 15:40:44.511605 dv-cinder-840678-12-iscsi devstack@n-api.service[124917]: clock source: unix May 23 15:40:44.511605 dv-cinder-840678-12-iscsi devstack@n-api.service[124917]: pcre jit disabled May 23 15:40:44.511605 dv-cinder-840678-12-iscsi devstack@n-api.service[124917]: detected number of CPU cores: 4 May 23 15:40:44.511605 dv-cinder-840678-12-iscsi devstack@n-api.service[124917]: current working directory: / May 23 15:40:44.511605 dv-cinder-840678-12-iscsi devstack@n-api.service[124917]: detected binary path: /usr/bin/uwsgi-core May 23 15:40:44.511605 dv-cinder-840678-12-iscsi devstack@n-api.service[124917]: your processes number limit is 47680 May 23 15:40:44.511605 dv-cinder-840678-12-iscsi devstack@n-api.service[124917]: your memory page size is 4096 bytes May 23 15:40:44.511605 dv-cinder-840678-12-iscsi devstack@n-api.service[124917]: detected max file descriptor number: 2048 May 23 15:40:44.511605 dv-cinder-840678-12-iscsi devstack@n-api.service[124917]: lock engine: pthread robust mutexes May 23 15:40:44.512796 dv-cinder-840678-12-iscsi devstack@n-api.service[124917]: thunder lock: enabled May 23 15:40:44.512796 dv-cinder-840678-12-iscsi devstack@n-api.service[124917]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 23 15:40:44.512796 dv-cinder-840678-12-iscsi devstack@n-api.service[124917]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 23 15:40:44.558996 dv-cinder-840678-12-iscsi devstack@n-api.service[124917]: Python main interpreter initialized at 0x557c48c479c0 May 23 15:40:44.558996 dv-cinder-840678-12-iscsi devstack@n-api.service[124917]: python threads support enabled May 23 15:40:44.558996 dv-cinder-840678-12-iscsi devstack@n-api.service[124917]: your server socket listen backlog is limited to 100 connections May 23 15:40:44.558996 dv-cinder-840678-12-iscsi devstack@n-api.service[124917]: your mercy for graceful operations on workers is 90 seconds May 23 15:40:44.559443 dv-cinder-840678-12-iscsi devstack@n-api.service[124917]: mapped 403077 bytes (393 KB) for 2 cores May 23 15:40:44.559443 dv-cinder-840678-12-iscsi devstack@n-api.service[124917]: *** Operational MODE: preforking *** May 23 15:40:44.559691 dv-cinder-840678-12-iscsi devstack@n-api.service[124917]: *** uWSGI is running in multiple interpreter mode *** May 23 15:40:44.559691 dv-cinder-840678-12-iscsi devstack@n-api.service[124917]: spawned uWSGI master process (pid: 124917) May 23 15:40:44.559898 dv-cinder-840678-12-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 23 15:40:44.561503 dv-cinder-840678-12-iscsi devstack@n-api.service[124917]: spawned uWSGI worker 1 (pid: 124933, cores: 1) May 23 15:40:44.561503 dv-cinder-840678-12-iscsi devstack@n-api.service[124917]: spawned uWSGI worker 2 (pid: 124934, cores: 1) May 23 15:40:44.561503 dv-cinder-840678-12-iscsi devstack@n-api.service[124917]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 23 15:40:45.755035 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 23 15:40:45.760294 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 23 15:40:46.554307 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 15:40:46.554307 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: from cryptography.utils import int_from_bytes May 23 15:40:46.554783 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 15:40:46.554783 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: from cryptography.utils import int_from_bytes May 23 15:40:46.563872 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 15:40:46.563872 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: from cryptography.utils import int_from_bytes May 23 15:40:46.564260 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 15:40:46.564260 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: from cryptography.utils import int_from_bytes May 23 15:40:49.016337 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 23 15:40:49.016908 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 23 15:40:49.017265 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 23 15:40:49.017655 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 23 15:40:49.018007 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 23 15:40:49.018409 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.018747 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.019077 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.019431 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.019772 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.020095 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.020423 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.020751 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.021105 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.021389 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.021701 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.022034 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-840678-12-iscsi {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.022365 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.022682 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.022999 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.023331 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.023644 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.023974 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.024287 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.024798 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.026242 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.026242 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.026242 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.026242 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.026602 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.026828 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.027159 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.027478 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.027791 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.028106 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.028938 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-840678-12-iscsi {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.028938 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.029412 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.029537 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.029868 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.030185 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.030498 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.030825 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.031158 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.031483 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.031809 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.032136 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.032464 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.033354 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.033765 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.034078 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.034385 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.034715 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.035042 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.035337 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.035596 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.035914 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.036242 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.036575 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.036902 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.037419 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.037543 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.037822 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.038215 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.038460 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.038775 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.039034 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 23 15:40:49.039474 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.039564 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 23 15:40:49.039640 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.039712 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.039907 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 23 15:40:49.040006 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.040253 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 23 15:40:49.040357 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.040516 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 23 15:40:49.040622 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.040880 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.040991 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.041270 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.041386 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.041537 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.041631 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.041851 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.041953 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.042172 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.042297 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.042557 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.042660 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.042836 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.042937 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.043136 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.043248 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.043482 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.043920 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.044070 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.044216 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.044370 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.044525 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.044679 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.044844 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-840678-12-iscsi {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.045010 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.045190 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.045353 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.045500 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.045653 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.045816 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.045963 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.046116 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.046264 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.046417 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.046564 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.046722 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.046870 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.047027 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.047184 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.047371 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.047564 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.047713 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.047880 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.048039 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.048185 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.048403 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.049121 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.049277 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.049435 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.049598 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.049761 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.049909 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.050070 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.050217 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.050371 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.050519 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.050677 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.050839 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.051015 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.051178 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.051338 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.051503 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.051661 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-840678-12-iscsi {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.051809 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.051955 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.052103 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.052249 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.052395 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.052574 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.052736 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.052736 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.053463 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.053636 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.053790 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.053967 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.057432 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.058127 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.058290 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.058442 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.058591 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.058834 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.059004 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.059163 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.059319 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.059469 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.059625 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.059781 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.059936 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.060094 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.060240 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.060389 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.060551 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.060706 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.060870 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.061019 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.061208 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.061368 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.061518 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.061673 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.061820 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.061975 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.062134 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.062299 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.062456 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.062612 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.062760 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.062942 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.063133 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.063312 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.063461 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.063618 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.063774 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.063945 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.064203 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.064392 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.064572 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.065899 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.066001 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.066091 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.066184 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.066266 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.066346 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.066425 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.066497 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.066567 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.066650 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.066770 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.066877 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.066957 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.067037 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.067150 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.067234 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.067308 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.067387 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.067465 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.067537 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.067615 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.067717 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.067798 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.067877 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.067959 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.068039 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.068120 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.068202 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.068284 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.068356 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.068356 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.068485 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.068568 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.068641 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.068718 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.068796 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.068873 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.068952 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.069030 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.069142 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.069227 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.069299 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.069378 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.069466 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.069554 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.069638 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.069722 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.069807 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.069896 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.069993 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.070084 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.070174 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.070266 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.070350 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.070434 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.070533 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.070625 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.070716 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.070800 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.070800 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.070968 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.071059 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.071059 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.071230 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.071316 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.071316 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.071485 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.071578 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.071578 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.071578 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.071811 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.071895 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.072554 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.072674 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.072770 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.072863 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.072955 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.073041 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.073165 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.073586 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.073699 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.073797 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.073918 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.074074 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.074257 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.074588 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.074682 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.074903 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.075189 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.075329 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.075776 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.075883 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.075980 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.076211 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.076323 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.076495 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.076779 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.076870 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.077135 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.077378 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.077471 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.077759 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.077961 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.078089 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.078408 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.078538 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.078728 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.079041 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.079132 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.079357 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.080119 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.080222 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.080526 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.080898 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.080989 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.081311 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.081517 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.081614 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.081971 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.082118 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.082290 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.082550 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.082642 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.082910 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.083138 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.083238 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.083524 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.083709 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.083877 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.084176 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.084275 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.084506 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.084777 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.084876 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.085372 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.085482 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.085599 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 15:40:49.086016 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.086164 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.086290 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.086388 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.086705 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.086814 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.086942 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.087157 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.087432 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.087533 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.087821 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.087994 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.088146 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.088472 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.088576 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.088814 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.089040 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.089162 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.089492 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.089622 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.089817 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.090126 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.090225 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.090464 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.090707 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.090805 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.091126 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.091259 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.091456 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.091780 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.091872 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.092101 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.092346 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.092439 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.092755 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.092904 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.093358 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.093494 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.093583 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.093772 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.093971 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.094129 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.094462 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.094561 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.094800 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.095046 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.095168 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.096359 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.096481 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.096601 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.096711 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.096809 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.097195 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.097315 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.097428 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.097716 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.097926 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.098045 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.098371 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.098505 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.098695 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.099018 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.099117 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.099341 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.099603 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.099694 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.099995 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.100180 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.100321 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.100646 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.100737 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.100970 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.101285 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.101392 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.101688 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.101873 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.102016 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.102340 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.102440 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.102659 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.102947 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.103040 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.103279 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.103551 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.103643 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.103901 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.104143 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.104234 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.104560 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.104720 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.104881 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.105272 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.105379 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.105606 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.105889 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.106016 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.106435 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.106530 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.106617 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.106874 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.107080 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.107205 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.107506 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.107608 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.107827 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.108129 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.108236 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.108473 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.108725 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.108823 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.109821 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.109992 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.110097 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.110256 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.110346 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.110439 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.110525 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.110525 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.110740 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.110928 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.111234 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.111452 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.111668 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.111790 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.112118 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.112245 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.112443 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.112754 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.112853 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.113144 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.113365 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.113465 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.113793 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.113958 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.114130 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.114466 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.114565 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.114784 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.115070 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.115169 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.115407 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.115657 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.115756 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.117671 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.117782 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.117894 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.117981 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.118064 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.118147 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.118464 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.118757 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.118936 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.118936 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.119113 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.119199 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.119199 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.119378 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.119467 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.119467 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.119467 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.119719 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.119817 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.119817 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.120026 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.120320 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.120414 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.120719 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.120919 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.121052 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.121411 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.121501 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.121738 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.122042 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.122136 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.122375 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.122628 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.122718 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.123011 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.123208 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.123333 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.123668 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.123765 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.123991 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.124303 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.124405 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.124636 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.124901 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.124992 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.125324 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.125507 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.125658 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.125978 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.126069 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.126306 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.126953 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.127148 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.127148 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.127499 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.127603 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.127906 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.128007 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.128105 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.128283 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.128506 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.128610 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.128912 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.129174 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.129287 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.129573 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.129664 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.129905 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.130218 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.130322 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.130545 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.130835 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.130933 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.131193 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.131418 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.131589 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.131915 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.132061 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.132154 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.132450 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.132549 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.132798 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.132969 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.133180 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.133442 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.133550 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.133817 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.133946 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.134151 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.134404 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.134496 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.134788 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.134890 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.135110 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.135353 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.135451 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.135729 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.135862 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.136051 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.136322 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.136412 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.136682 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.136830 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.137013 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.137322 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.137433 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.137653 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.137763 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.137971 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.138087 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.138283 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.138375 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.138600 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.138703 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.138922 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.139024 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.139257 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.139363 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.139577 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.139683 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.139899 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.140000 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.140230 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.140320 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.140547 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.140647 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.140863 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.140962 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.141207 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.141315 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.141524 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.141615 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.141837 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.141936 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.142674 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.142778 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.142994 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.143232 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.143344 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.143555 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.143648 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.143878 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.143969 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.144198 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.144299 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.144523 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.144621 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.144849 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.144940 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.145198 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.145311 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.145514 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.145605 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.145835 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.145926 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.146167 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.146272 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.146487 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.146585 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.146804 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.146913 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.147178 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.147302 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.147435 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.147527 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.147750 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.147853 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.148078 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.148205 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.148453 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.148557 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.148696 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.148816 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.148998 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.149223 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.149329 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.149414 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.149651 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.149748 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.149972 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.150074 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.150283 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.150379 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.150607 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.150880 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.151027 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.151225 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.151362 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.151567 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.151714 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.151857 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.151989 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.152157 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.152303 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.152483 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.152625 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.152801 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.152945 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.153136 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.153305 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.153440 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.153571 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.153755 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.153905 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.154070 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.154215 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.154384 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.154521 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.154763 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.154907 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.155088 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.155238 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.155409 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.155545 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.155728 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.155855 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.156046 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.156182 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.156374 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.156506 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.156694 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.156822 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.157115 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.157397 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.157524 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.158349 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.158507 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.158507 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.158833 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.158950 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.159069 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.159190 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.159332 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.159453 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.159654 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.159776 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.159996 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.160124 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.160320 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.160440 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.160776 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.161649 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.161649 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.161877 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.161983 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.162074 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.162174 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.162423 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.162609 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.162789 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.162949 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.163111 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.163212 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.163459 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.163570 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.163732 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.163853 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.164108 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.164263 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.164430 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.164535 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.164748 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.164855 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.165084 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.165189 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.165415 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.165528 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.165743 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.165838 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.166067 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.166240 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.166405 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.166574 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.166715 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.166854 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.167003 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.167160 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.167308 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.167460 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.167608 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.167797 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.167956 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.168099 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.168246 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.168404 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.168803 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.169050 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.169162 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.169365 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.169472 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.169690 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.169790 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.170042 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.170133 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.170365 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.170467 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.170726 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.170832 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.171002 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.171094 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.171319 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.171437 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.171647 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.171847 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.171991 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.172127 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.172311 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.172418 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.172626 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.172717 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.172942 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.173032 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.173325 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.173429 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.173643 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.173778 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.173971 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.174180 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.174282 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.174507 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.174599 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.174826 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.174940 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.175149 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.175248 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.175472 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.175564 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.175789 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.175881 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.176105 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.176205 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.176427 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.176518 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.176764 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.176857 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.177119 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.177213 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.177438 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.177577 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.177758 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.177856 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.178072 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.178171 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.178388 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.178489 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.178701 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.178798 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.179018 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.179128 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.179332 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.179430 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.179646 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.179745 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.179957 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.180049 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.180272 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.180373 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.180588 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.180708 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.180939 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.181035 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.181265 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.181385 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.181588 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.181693 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.181904 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.182005 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.182216 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.182307 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.182538 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.182641 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.182854 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.182946 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.183169 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.183261 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.183496 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.183601 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.183833 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.183924 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.184160 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.184258 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.184475 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.184566 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.184794 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.184892 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.185253 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.185387 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.185490 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.185577 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.185792 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.185919 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.186117 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.186233 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.186434 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.186552 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.186745 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.186846 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.187058 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.187176 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.187374 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.187491 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.187700 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.187832 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.188016 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.188134 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.188350 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.188442 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.188666 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.188753 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.188982 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.189175 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.189321 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.189572 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.189671 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.189900 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.189991 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.190225 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.190318 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.190549 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.190641 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.190872 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.190971 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.191194 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.191306 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.191520 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.191612 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.191845 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.191942 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.192170 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.192262 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.192490 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.192581 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.192811 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.192911 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.193152 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.193257 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.193472 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.193592 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.193795 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.193904 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.194111 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.194203 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.194441 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.194531 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.194759 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.194915 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.195078 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.195183 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.195396 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.195486 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.195713 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.195809 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.196038 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.196138 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.196355 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.196446 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.196675 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.196806 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.196995 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.197159 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.197369 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.197475 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.197692 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.197797 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.198013 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.198103 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.198336 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.198435 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.198661 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.198753 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.198984 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.199084 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.199305 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.199397 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.199627 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.199762 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.199943 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.200089 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.200263 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.200414 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.200581 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.200740 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.200896 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.201074 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.201258 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.201396 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.201578 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.201721 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.201895 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.202060 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.202216 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.202379 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.202531 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.202697 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.202879 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.203015 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.203196 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.203351 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.203668 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.204005 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.204293 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.204437 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.205427 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.205535 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.205622 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.205705 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.205950 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.206043 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.206282 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.206375 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.206611 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.206703 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.206944 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.207037 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.207275 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.207367 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.207595 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.207688 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.207933 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.208032 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.208260 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.208354 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.208585 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.208676 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.208922 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.209019 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.209298 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.209404 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.209618 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.209705 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.209941 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.210045 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.210260 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.210353 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.210581 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.210679 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.210897 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.211003 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.211213 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.211307 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.211549 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.211658 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.211865 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.211967 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.212200 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.212296 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.212602 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.212717 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.212939 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.213048 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.213278 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.213369 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.213608 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.213713 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.213926 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.214018 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.214252 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.214351 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.214570 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.214664 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.214888 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.214989 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.215226 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.215318 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.215553 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.215647 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.215880 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.215980 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.216207 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.216308 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.216530 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.216623 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.216847 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.216940 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.217184 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.217299 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.217509 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.217597 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.217829 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.217930 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.218173 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.218363 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.218489 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.218626 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.218809 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.218912 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.219145 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.219268 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.219457 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.219557 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.219852 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.220045 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.220216 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.220824 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.221069 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.221329 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.221625 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.221779 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.222165 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.222540 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.222674 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.222924 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.223025 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.223120 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.223215 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.223301 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.223392 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.223476 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.223560 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.223650 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.223851 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.223946 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.224198 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.224298 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.224527 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.224618 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.224849 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.224941 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.225193 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.225301 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.225511 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.225610 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.225838 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.225930 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.226152 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.226243 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.226472 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.226576 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.226788 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.226880 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.227104 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.227305 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.227451 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.227594 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.227768 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.227923 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.228313 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.228531 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.228633 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.228728 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.228814 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.228896 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.229081 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.229176 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.229408 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.229509 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.229740 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.229839 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.230061 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.230168 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.230373 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.230464 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.230689 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.230781 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.231006 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.231123 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.231353 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.231476 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.231669 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.231779 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.232016 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.232164 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.232349 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.232434 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.232683 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.232904 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.233045 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.233202 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.233359 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.233509 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.233648 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.233788 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.233968 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.234123 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.234273 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.234420 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.234578 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.234718 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.234866 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.235018 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.235185 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.235334 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.235497 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.235708 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.235912 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.236061 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.236211 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.236349 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.236561 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.236716 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.237019 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.237210 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.237392 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.237542 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.237693 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.237856 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.238005 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.238187 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.238322 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.238459 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.238679 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.238833 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.238989 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.239136 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.239270 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.239458 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.239600 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.239786 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.239937 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.240117 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.240266 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.240495 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.240652 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.240788 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.240951 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.241188 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.241396 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.241541 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.241702 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.241801 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.241884 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.242085 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.242222 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.242410 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.242509 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.242736 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.242825 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.243063 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.243162 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.243393 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.243484 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.243713 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.243812 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.244040 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.244139 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.244367 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.244473 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.244692 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.244783 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.245017 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.245279 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.245381 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.245623 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.245716 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.245953 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.246046 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.246281 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.246377 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.246605 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.246703 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.246929 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.247027 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.247251 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.247350 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.247571 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.247662 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.247891 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.247981 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.248211 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.248317 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.248531 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.248630 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.248870 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.248962 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.249225 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.249319 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.249552 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.249652 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.249878 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.249978 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.250204 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.250297 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.250545 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.250734 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.250855 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.251065 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.251200 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.251436 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.251579 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.251850 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.252030 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.252193 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.252355 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.252507 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.252602 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.252753 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.252921 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.253120 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.253270 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.253442 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.253619 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.253763 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.253912 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.254065 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.254229 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.254449 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.254592 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.254734 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.254884 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.255027 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.255178 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.255326 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.255493 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.255630 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.255816 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.255960 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.256152 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.256290 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.256497 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.256789 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.256936 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.257162 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.257310 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.257489 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.257625 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.257814 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.257963 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.258151 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.258347 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.258494 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.258674 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.258823 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.259022 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.259168 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.259361 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.259556 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.259696 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.259846 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.260015 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.260157 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.260335 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.260473 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.260655 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.260757 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.260972 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.261083 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.261314 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.261415 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.261633 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.261751 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.262016 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.262135 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.262259 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.262350 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.262571 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.262662 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.262898 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.262988 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.263211 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.263409 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.263555 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.263697 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.263872 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.263973 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.264194 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.264411 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.264512 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.264765 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.264865 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.265114 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.265239 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.265441 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.265555 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.265764 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.265867 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.266080 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.266181 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.266458 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.266583 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.266710 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.266821 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.267540 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.267652 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.267913 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.268028 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.268246 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.268431 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.268560 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.268811 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.268923 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.269177 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.269281 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.269498 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.269625 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.269817 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.269931 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.270136 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.270238 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.270456 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.270564 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.270769 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.270877 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.271104 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.271213 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.271420 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.271523 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.271751 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.271854 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.272132 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.272240 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.272395 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.272648 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.272764 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.272996 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.273117 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.273359 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.273468 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.273676 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.273806 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.274006 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.274143 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.274323 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.274416 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.274639 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.274731 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.274951 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.275043 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.275273 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.275366 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.275589 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.275689 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.275908 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.275999 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.276236 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.276336 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.276561 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.276655 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.276883 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.276977 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.277220 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.277449 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.277569 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.277664 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.277849 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.277955 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.278172 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.278274 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.278490 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.278581 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.278812 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.279071 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.279169 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.279265 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.279488 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.279585 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.279845 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.280139 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.280291 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.280489 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.280591 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.280818 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.280924 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.281173 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.281285 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.281499 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.281591 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.281817 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.281915 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.282137 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.282281 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.282523 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.282626 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.282877 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.283029 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.283181 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.283345 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.283486 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.283633 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.283768 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.283910 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.284087 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.284283 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.284410 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.284616 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.284744 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.284947 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.285053 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.285309 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.285417 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.285633 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.285739 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.285971 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.286085 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.286287 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.286381 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.286606 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.286706 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.286933 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.287086 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.287238 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.287380 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.287577 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.287821 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.287976 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.288130 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.288280 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.288421 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.288561 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.288701 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.288875 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.289022 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.289220 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.289313 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.289542 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.289642 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.289917 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.290036 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.290181 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.290282 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.290500 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.290601 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.290817 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.290936 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.291135 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.291232 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.291453 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.291559 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.291769 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.291861 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.292086 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.292178 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.292408 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.292542 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.292723 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.292829 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.293042 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.293182 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.293381 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.293487 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.293953 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.294046 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.294268 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.294360 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.294586 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.294683 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.294901 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.294993 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.295218 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.295325 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.295539 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.295639 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.295854 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.295954 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.296175 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.296282 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.296489 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.296585 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.296802 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.296904 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.297142 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.297262 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.297487 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.297590 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.297832 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.297927 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.298146 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.298246 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.299105 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.299195 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.299305 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.299406 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.299617 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.299722 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.299931 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.300052 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.300246 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.300339 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.300560 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.300653 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.300876 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.300976 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.301213 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.301329 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.301529 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.301630 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.301842 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.301942 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.302155 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.302255 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.302472 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.302597 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.302785 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.302891 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.303101 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.303204 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.303413 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.303528 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.303727 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.303838 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.304040 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.304157 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.304357 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.304460 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.304670 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.304795 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.305013 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.305205 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.305421 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.305524 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.305717 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.305810 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.306040 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.306212 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.306348 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.306572 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.306679 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.306767 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.307000 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.307101 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.307333 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.307454 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.307666 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.307760 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.307992 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.308085 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.308312 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.308406 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.308641 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.308744 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.308960 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.309052 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.309334 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.309436 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.309646 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.309743 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.309975 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.310070 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.310368 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.310464 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.310611 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.310786 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.310938 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.311072 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.311272 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.311433 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.311589 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.311774 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.311924 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.312105 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.312264 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.312433 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.312605 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.312803 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.312920 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.312996 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 23 15:40:49.313244 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.313587 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.313964 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.314297 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.314660 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.314982 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.315309 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.315632 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.315961 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.316299 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.316636 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.316956 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.317324 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.317662 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.318022 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.318347 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.318697 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.319035 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.319368 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.319692 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.320012 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 15:40:49.320264 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 23 15:40:49.374043 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO dbcounter [None req-576c5a15-1df9-469c-a712-c1997f61ad4f None None] Registered counter for database nova_api May 23 15:40:49.381069 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO dbcounter [None req-efd79e3f-2b2b-4cf6-ad3f-6c0ad5005bf2 None None] Registered counter for database nova_api May 23 15:40:49.394482 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_db.sqlalchemy.engines [None req-576c5a15-1df9-469c-a712-c1997f61ad4f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124933) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 15:40:49.401014 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_db.sqlalchemy.engines [None req-efd79e3f-2b2b-4cf6-ad3f-6c0ad5005bf2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124934) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 15:40:49.402168 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writer thread running {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 15:40:49.409142 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writer thread running {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 15:40:49.460331 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.context [None req-576c5a15-1df9-469c-a712-c1997f61ad4f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ad186f54-45d6-4a29-af7e-16215b0c4892(cell1) {{(pid=124933) load_cells /opt/stack/nova/nova/context.py:464}} May 23 15:40:49.464503 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-576c5a15-1df9-469c-a712-c1997f61ad4f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:40:49.465925 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.context [None req-efd79e3f-2b2b-4cf6-ad3f-6c0ad5005bf2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ad186f54-45d6-4a29-af7e-16215b0c4892(cell1) {{(pid=124934) load_cells /opt/stack/nova/nova/context.py:464}} May 23 15:40:49.466176 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-576c5a15-1df9-469c-a712-c1997f61ad4f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:40:49.466991 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-576c5a15-1df9-469c-a712-c1997f61ad4f None None] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:40:49.468992 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-576c5a15-1df9-469c-a712-c1997f61ad4f None None] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:40:49.470071 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-efd79e3f-2b2b-4cf6-ad3f-6c0ad5005bf2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:40:49.471297 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO dbcounter [None req-576c5a15-1df9-469c-a712-c1997f61ad4f None None] Registered counter for database nova_cell0 May 23 15:40:49.471714 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-efd79e3f-2b2b-4cf6-ad3f-6c0ad5005bf2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:40:49.472546 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-efd79e3f-2b2b-4cf6-ad3f-6c0ad5005bf2 None None] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:40:49.474680 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-efd79e3f-2b2b-4cf6-ad3f-6c0ad5005bf2 None None] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:40:49.475383 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO dbcounter [None req-576c5a15-1df9-469c-a712-c1997f61ad4f None None] Registered counter for database nova_cell1 May 23 15:40:49.476687 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO dbcounter [None req-efd79e3f-2b2b-4cf6-ad3f-6c0ad5005bf2 None None] Registered counter for database nova_cell0 May 23 15:40:49.480858 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO dbcounter [None req-efd79e3f-2b2b-4cf6-ad3f-6c0ad5005bf2 None None] Registered counter for database nova_cell1 May 23 15:40:49.483046 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_db.sqlalchemy.engines [None req-576c5a15-1df9-469c-a712-c1997f61ad4f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124933) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 15:40:49.487100 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_db.sqlalchemy.engines [None req-576c5a15-1df9-469c-a712-c1997f61ad4f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124933) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 15:40:49.488119 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_db.sqlalchemy.engines [None req-efd79e3f-2b2b-4cf6-ad3f-6c0ad5005bf2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124934) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 15:40:49.489467 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_db.sqlalchemy.engines [None req-efd79e3f-2b2b-4cf6-ad3f-6c0ad5005bf2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124934) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 15:40:49.490602 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writer thread running {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 15:40:49.495881 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writer thread running {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 15:40:49.498167 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writer thread running {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 15:40:49.636452 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writer thread running {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 15:40:49.645955 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO dbcounter [None req-576c5a15-1df9-469c-a712-c1997f61ad4f None None] Registered counter for database nova_cell0 May 23 15:40:49.650108 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO dbcounter [None req-efd79e3f-2b2b-4cf6-ad3f-6c0ad5005bf2 None None] Registered counter for database nova_cell0 May 23 15:40:49.652689 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_db.sqlalchemy.engines [None req-576c5a15-1df9-469c-a712-c1997f61ad4f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124933) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 15:40:49.656280 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_db.sqlalchemy.engines [None req-efd79e3f-2b2b-4cf6-ad3f-6c0ad5005bf2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124934) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 15:40:49.657377 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writer thread running {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 15:40:49.660970 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writer thread running {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 15:40:49.981151 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: WARNING keystonemiddleware.auth_token [None req-576c5a15-1df9-469c-a712-c1997f61ad4f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 15:40:49.989157 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: WARNING keystonemiddleware.auth_token [None req-576c5a15-1df9-469c-a712-c1997f61ad4f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 15:40:49.995129 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: WARNING keystonemiddleware.auth_token [None req-efd79e3f-2b2b-4cf6-ad3f-6c0ad5005bf2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 15:40:50.003692 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: WARNING keystonemiddleware.auth_token [None req-efd79e3f-2b2b-4cf6-ad3f-6c0ad5005bf2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 15:40:50.339398 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: WARNING keystonemiddleware.auth_token [None req-576c5a15-1df9-469c-a712-c1997f61ad4f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 15:40:50.346550 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: WARNING keystonemiddleware.auth_token [None req-576c5a15-1df9-469c-a712-c1997f61ad4f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 15:40:50.351896 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557c48c479c0 pid: 124933 (default app) May 23 15:40:50.355541 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: WARNING keystonemiddleware.auth_token [None req-efd79e3f-2b2b-4cf6-ad3f-6c0ad5005bf2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 15:40:50.362189 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: WARNING keystonemiddleware.auth_token [None req-efd79e3f-2b2b-4cf6-ad3f-6c0ad5005bf2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 15:40:50.367554 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557c48c479c0 pid: 124934 (default app) May 23 15:41:32.137593 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_api:SELECT=3 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:41:32.138407 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_cell0:SELECT=3 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:41:32.139479 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_cell1:SELECT=3 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:41:32.140541 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_cell0:SELECT=3 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:41:32.298878 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_api:SELECT=3 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:41:32.300120 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_cell0:SELECT=3 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:41:32.301741 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_cell1:SELECT=3 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:41:32.303491 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_cell0:SELECT=3 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:41:33.243950 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-a8443a51-51a6-4f39-9d59-036d227a3a18 tempest-VolumesNegativeTest-2101629547 tempest-VolumesNegativeTest-2101629547-project] Action: 'create', calling method: .version_select at 0x7fab53efdc10>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-791763495", "metadata": {"Type": "work"}}} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:41:33.266429 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-a8443a51-51a6-4f39-9d59-036d227a3a18 tempest-VolumesNegativeTest-2101629547 tempest-VolumesNegativeTest-2101629547-project] Request method failure captured: May 23 15:41:33.266429 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 23 15:41:33.266429 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Accept: application/json May 23 15:41:33.266429 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Accept-Encoding: identity May 23 15:41:33.266429 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Connection: close May 23 15:41:33.266429 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Content-Length: 121 May 23 15:41:33.266429 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Content-Type: application/json May 23 15:41:33.266429 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Host: 10.222.0.64 May 23 15:41:33.266429 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Openstack-System-Scope: None May 23 15:41:33.266429 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: User-Agent: python-urllib3/1.26.9 May 23 15:41:33.266429 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Auth-Token: gAAAAABii6ss8RanA61FXiaHPOrSLTb7WkznhOQarIufM_jCHQX6W4kE9lpvhYI3BskRuxjJ_ptYPU2uImjbi6acFrye-FNthMMjId_jxsA1BWzv0bap6QHYuIXYgXYH3qjKb54hk9-DSSgJO96xhe0FGFlqB2MHor55MQfiw6KIPiRL_3Istcw May 23 15:41:33.266429 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Domain-Id: None May 23 15:41:33.266429 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Domain-Name: None May 23 15:41:33.266429 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Identity-Status: Confirmed May 23 15:41:33.266429 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Is-Admin-Project: True May 23 15:41:33.266429 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Domain-Id: default May 23 15:41:33.266429 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Domain-Name: Default May 23 15:41:33.266429 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Id: f380b8a58cfc4b71b86681885ed58031 May 23 15:41:33.266429 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Name: tempest-VolumesNegativeTest-2101629547 May 23 15:41:33.266429 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Role: reader,member May 23 15:41:33.266429 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Roles: reader,member May 23 15:41:33.268187 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f380b8a58cfc4b71b86681885ed58031"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/f380b8a58cfc4b71b86681885ed58031"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f380b8a58cfc4b71b86681885ed58031"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_f380b8a58cfc4b71b86681885ed58031", "adminURL": "http://10.222.0.64:8080"}]}] May 23 15:41:33.268187 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant: tempest-VolumesNegativeTest-2101629547 May 23 15:41:33.268187 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant-Id: f380b8a58cfc4b71b86681885ed58031 May 23 15:41:33.268187 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant-Name: tempest-VolumesNegativeTest-2101629547 May 23 15:41:33.268187 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User: tempest-VolumesNegativeTest-2101629547-project May 23 15:41:33.268187 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Domain-Id: default May 23 15:41:33.268187 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Domain-Name: Default May 23 15:41:33.268187 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Id: 48352fabb230456690e795d91115605b May 23 15:41:33.268187 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Name: tempest-VolumesNegativeTest-2101629547-project May 23 15:41:33.268187 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: May 23 15:41:33.268187 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-791763495", "metadata": {"Type": "work"}}} May 23 15:41:33.268187 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: method: May 23 15:41:33.268187 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 23 15:41:33.277088 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-791763495', 'metadata': {'Type': 'work'}}}} May 23 15:41:33.277088 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:41:33.277088 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:41:33.277088 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 23 15:41:33.277088 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 23 15:41:33.277088 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 23 15:41:33.277088 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise error May 23 15:41:33.277088 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 23 15:41:33.277088 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:41:33.277088 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 23 15:41:33.277088 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 23 15:41:33.277088 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:41:33.277088 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi On instance['volume']: May 23 15:41:33.277088 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi '#$%' May 23 15:41:33.277088 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:41:33.277088 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:41:33.277088 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:41:33.277088 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:41:33.277088 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:41:33.277088 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:41:33.277088 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:41:33.277088 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:41:33.280440 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 15:41:33.280440 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 15:41:33.280440 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:41:33.280440 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:41:33.280440 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 23 15:41:33.280440 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 23 15:41:33.280440 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 23 15:41:33.280440 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 23 15:41:33.280440 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 23 15:41:33.280440 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 23 15:41:33.280440 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 23 15:41:33.280440 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:41:33.280440 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:41:33.280440 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:41:33.280440 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:41:33.280440 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:41:33.280440 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:41:33.280440 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 23 15:41:33.280440 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 23 15:41:33.281938 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 23 15:41:33.281938 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:41:33.281938 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-a8443a51-51a6-4f39-9d59-036d227a3a18 tempest-VolumesNegativeTest-2101629547 tempest-VolumesNegativeTest-2101629547-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:41:33.281938 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-a8443a51-51a6-4f39-9d59-036d227a3a18 tempest-VolumesNegativeTest-2101629547 tempest-VolumesNegativeTest-2101629547-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.140821 May 23 15:41:33.281938 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 1/1] 10.222.0.64 () {60 vars in 1155 bytes} [Mon May 23 15:41:32 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1145 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 23 15:41:33.287081 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-e76798e8-aeba-4c03-9e32-b8d9aa5e18fa tempest-VolumesNegativeTest-2101629547 tempest-VolumesNegativeTest-2101629547-project] Action: 'create', calling method: .version_select at 0x7fab53debee0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1732979902", "metadata": {"Type": "work"}}} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:41:33.290451 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-e76798e8-aeba-4c03-9e32-b8d9aa5e18fa tempest-VolumesNegativeTest-2101629547 tempest-VolumesNegativeTest-2101629547-project] Request method failure captured: May 23 15:41:33.290451 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 23 15:41:33.290451 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Accept: application/json May 23 15:41:33.290451 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Accept-Encoding: identity May 23 15:41:33.290451 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Connection: close May 23 15:41:33.290451 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Content-Length: 120 May 23 15:41:33.290451 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Content-Type: application/json May 23 15:41:33.290451 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Host: 10.222.0.64 May 23 15:41:33.290451 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Openstack-System-Scope: None May 23 15:41:33.290451 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: User-Agent: python-urllib3/1.26.9 May 23 15:41:33.290451 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Auth-Token: gAAAAABii6ss8RanA61FXiaHPOrSLTb7WkznhOQarIufM_jCHQX6W4kE9lpvhYI3BskRuxjJ_ptYPU2uImjbi6acFrye-FNthMMjId_jxsA1BWzv0bap6QHYuIXYgXYH3qjKb54hk9-DSSgJO96xhe0FGFlqB2MHor55MQfiw6KIPiRL_3Istcw May 23 15:41:33.290451 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Domain-Id: None May 23 15:41:33.290451 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Domain-Name: None May 23 15:41:33.290451 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Identity-Status: Confirmed May 23 15:41:33.290451 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Is-Admin-Project: True May 23 15:41:33.290451 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Domain-Id: default May 23 15:41:33.290451 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Domain-Name: Default May 23 15:41:33.290451 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Id: f380b8a58cfc4b71b86681885ed58031 May 23 15:41:33.290451 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Name: tempest-VolumesNegativeTest-2101629547 May 23 15:41:33.290451 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Role: reader,member May 23 15:41:33.290451 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Roles: reader,member May 23 15:41:33.292014 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f380b8a58cfc4b71b86681885ed58031"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/f380b8a58cfc4b71b86681885ed58031"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f380b8a58cfc4b71b86681885ed58031"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_f380b8a58cfc4b71b86681885ed58031", "adminURL": "http://10.222.0.64:8080"}]}] May 23 15:41:33.292014 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant: tempest-VolumesNegativeTest-2101629547 May 23 15:41:33.292014 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant-Id: f380b8a58cfc4b71b86681885ed58031 May 23 15:41:33.292014 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant-Name: tempest-VolumesNegativeTest-2101629547 May 23 15:41:33.292014 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User: tempest-VolumesNegativeTest-2101629547-project May 23 15:41:33.292014 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Domain-Id: default May 23 15:41:33.292014 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Domain-Name: Default May 23 15:41:33.292014 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Id: 48352fabb230456690e795d91115605b May 23 15:41:33.292014 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Name: tempest-VolumesNegativeTest-2101629547-project May 23 15:41:33.292014 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: May 23 15:41:33.292014 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1732979902", "metadata": {"Type": "work"}}} May 23 15:41:33.292014 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: method: May 23 15:41:33.292014 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 23 15:41:33.293324 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1732979902', 'metadata': {'Type': 'work'}}}} May 23 15:41:33.293324 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:41:33.293324 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:41:33.293324 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 23 15:41:33.293324 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 23 15:41:33.293324 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 23 15:41:33.293324 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise error May 23 15:41:33.293324 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 23 15:41:33.293324 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:41:33.293324 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 23 15:41:33.293324 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 23 15:41:33.293324 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:41:33.293324 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi On instance['volume']: May 23 15:41:33.293324 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi '0' May 23 15:41:33.293324 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:41:33.293324 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:41:33.293324 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:41:33.293324 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:41:33.293324 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:41:33.293324 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:41:33.293324 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:41:33.293324 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:41:33.296679 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 15:41:33.296679 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 15:41:33.296679 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:41:33.296679 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:41:33.296679 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 23 15:41:33.296679 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 23 15:41:33.296679 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 23 15:41:33.296679 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 23 15:41:33.296679 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 23 15:41:33.296679 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 23 15:41:33.296679 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 23 15:41:33.296679 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:41:33.296679 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:41:33.296679 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:41:33.296679 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:41:33.296679 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:41:33.296679 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:41:33.296679 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 23 15:41:33.296679 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 23 15:41:33.299069 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 23 15:41:33.299069 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:41:33.300193 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-e76798e8-aeba-4c03-9e32-b8d9aa5e18fa tempest-VolumesNegativeTest-2101629547 tempest-VolumesNegativeTest-2101629547-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:41:33.301357 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-e76798e8-aeba-4c03-9e32-b8d9aa5e18fa tempest-VolumesNegativeTest-2101629547 tempest-VolumesNegativeTest-2101629547-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.018490 May 23 15:41:33.302500 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 2/2] 10.222.0.64 () {60 vars in 1155 bytes} [Mon May 23 15:41:33 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 23 15:41:33.314027 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-5e782908-6140-4933-835f-7f18b3dcd52f tempest-VolumesNegativeTest-2101629547 tempest-VolumesNegativeTest-2101629547-project] Action: 'create', calling method: .version_select at 0x7fab53deb0d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1121110042", "metadata": {"Type": "work"}}} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:41:33.317486 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-5e782908-6140-4933-835f-7f18b3dcd52f tempest-VolumesNegativeTest-2101629547 tempest-VolumesNegativeTest-2101629547-project] Request method failure captured: May 23 15:41:33.317486 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 23 15:41:33.317486 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Accept: application/json May 23 15:41:33.317486 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Accept-Encoding: identity May 23 15:41:33.317486 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Connection: close May 23 15:41:33.317486 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Content-Length: 119 May 23 15:41:33.317486 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Content-Type: application/json May 23 15:41:33.317486 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Host: 10.222.0.64 May 23 15:41:33.317486 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Openstack-System-Scope: None May 23 15:41:33.317486 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: User-Agent: python-urllib3/1.26.9 May 23 15:41:33.317486 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Auth-Token: gAAAAABii6ss8RanA61FXiaHPOrSLTb7WkznhOQarIufM_jCHQX6W4kE9lpvhYI3BskRuxjJ_ptYPU2uImjbi6acFrye-FNthMMjId_jxsA1BWzv0bap6QHYuIXYgXYH3qjKb54hk9-DSSgJO96xhe0FGFlqB2MHor55MQfiw6KIPiRL_3Istcw May 23 15:41:33.317486 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Domain-Id: None May 23 15:41:33.317486 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Domain-Name: None May 23 15:41:33.317486 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Identity-Status: Confirmed May 23 15:41:33.317486 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Is-Admin-Project: True May 23 15:41:33.317486 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Domain-Id: default May 23 15:41:33.317486 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Domain-Name: Default May 23 15:41:33.317486 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Id: f380b8a58cfc4b71b86681885ed58031 May 23 15:41:33.317486 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Name: tempest-VolumesNegativeTest-2101629547 May 23 15:41:33.317486 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Role: reader,member May 23 15:41:33.317486 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Roles: reader,member May 23 15:41:33.319528 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f380b8a58cfc4b71b86681885ed58031"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/f380b8a58cfc4b71b86681885ed58031"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f380b8a58cfc4b71b86681885ed58031"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_f380b8a58cfc4b71b86681885ed58031", "adminURL": "http://10.222.0.64:8080"}]}] May 23 15:41:33.319528 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant: tempest-VolumesNegativeTest-2101629547 May 23 15:41:33.319528 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant-Id: f380b8a58cfc4b71b86681885ed58031 May 23 15:41:33.319528 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant-Name: tempest-VolumesNegativeTest-2101629547 May 23 15:41:33.319528 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User: tempest-VolumesNegativeTest-2101629547-project May 23 15:41:33.319528 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Domain-Id: default May 23 15:41:33.319528 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Domain-Name: Default May 23 15:41:33.319528 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Id: 48352fabb230456690e795d91115605b May 23 15:41:33.319528 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Name: tempest-VolumesNegativeTest-2101629547-project May 23 15:41:33.319528 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: May 23 15:41:33.319528 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1121110042", "metadata": {"Type": "work"}}} May 23 15:41:33.319528 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: method: May 23 15:41:33.319528 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 23 15:41:33.320358 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1121110042', 'metadata': {'Type': 'work'}}}} May 23 15:41:33.320358 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:41:33.320358 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:41:33.320358 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 23 15:41:33.320358 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 23 15:41:33.320358 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 23 15:41:33.320358 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise error May 23 15:41:33.320358 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 23 15:41:33.320358 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:41:33.320358 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 23 15:41:33.320358 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 23 15:41:33.320358 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:41:33.320358 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi On instance['volume']: May 23 15:41:33.320358 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi '' May 23 15:41:33.320358 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:41:33.320358 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:41:33.320358 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:41:33.320358 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:41:33.320358 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:41:33.320358 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:41:33.320358 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:41:33.320358 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:41:33.322173 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 15:41:33.322173 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 15:41:33.322173 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:41:33.322173 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:41:33.322173 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 23 15:41:33.322173 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 23 15:41:33.322173 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 23 15:41:33.322173 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 23 15:41:33.322173 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 23 15:41:33.322173 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 23 15:41:33.322173 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 23 15:41:33.322173 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:41:33.322173 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:41:33.322173 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:41:33.322173 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:41:33.322173 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:41:33.322173 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:41:33.322173 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 23 15:41:33.322173 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 23 15:41:33.323291 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 23 15:41:33.323291 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:41:33.324696 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-5e782908-6140-4933-835f-7f18b3dcd52f tempest-VolumesNegativeTest-2101629547 tempest-VolumesNegativeTest-2101629547-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:41:33.326045 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-5e782908-6140-4933-835f-7f18b3dcd52f tempest-VolumesNegativeTest-2101629547 tempest-VolumesNegativeTest-2101629547-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.018448 May 23 15:41:33.328058 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 3/3] 10.222.0.64 () {60 vars in 1155 bytes} [Mon May 23 15:41:33 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 23 15:41:33.337971 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-731cf670-a17b-4590-b83c-e0b2283b3122 tempest-VolumesNegativeTest-2101629547 tempest-VolumesNegativeTest-2101629547-project] Calling method '.version_select at 0x7fab53daeb80>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:33.878177 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-08bce52e-9326-4c41-ad71-860bd4601684 tempest-VolumesSnapshotsTestJSON-1379251994 tempest-VolumesSnapshotsTestJSON-1379251994-project] Action: 'create', calling method: .version_select at 0x7fab53efcc10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-906143777"}} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:41:34.287796 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.wsgi [None req-731cf670-a17b-4590-b83c-e0b2283b3122 tempest-VolumesNegativeTest-2101629547 tempest-VolumesNegativeTest-2101629547-project] HTTP exception thrown: Volume tempest-invalid-966893539 could not be found. May 23 15:41:34.297210 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-731cf670-a17b-4590-b83c-e0b2283b3122 tempest-VolumesNegativeTest-2101629547 tempest-VolumesNegativeTest-2101629547-project] Request method failure captured: May 23 15:41:34.297210 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-966893539 HTTP/1.1 May 23 15:41:34.297210 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Accept: application/json May 23 15:41:34.297210 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Accept-Encoding: identity May 23 15:41:34.297210 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Connection: close May 23 15:41:34.297210 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Content-Length: 0 May 23 15:41:34.297210 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Content-Type: application/json May 23 15:41:34.297210 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Host: 10.222.0.64 May 23 15:41:34.297210 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Openstack-System-Scope: None May 23 15:41:34.297210 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: User-Agent: python-urllib3/1.26.9 May 23 15:41:34.297210 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Auth-Token: gAAAAABii6ss8RanA61FXiaHPOrSLTb7WkznhOQarIufM_jCHQX6W4kE9lpvhYI3BskRuxjJ_ptYPU2uImjbi6acFrye-FNthMMjId_jxsA1BWzv0bap6QHYuIXYgXYH3qjKb54hk9-DSSgJO96xhe0FGFlqB2MHor55MQfiw6KIPiRL_3Istcw May 23 15:41:34.297210 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Domain-Id: None May 23 15:41:34.297210 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Domain-Name: None May 23 15:41:34.297210 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Identity-Status: Confirmed May 23 15:41:34.297210 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Is-Admin-Project: True May 23 15:41:34.297210 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Domain-Id: default May 23 15:41:34.297210 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Domain-Name: Default May 23 15:41:34.297210 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Id: f380b8a58cfc4b71b86681885ed58031 May 23 15:41:34.297210 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Name: tempest-VolumesNegativeTest-2101629547 May 23 15:41:34.297210 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Role: reader,member May 23 15:41:34.297210 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Roles: reader,member May 23 15:41:34.298774 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f380b8a58cfc4b71b86681885ed58031"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/f380b8a58cfc4b71b86681885ed58031"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f380b8a58cfc4b71b86681885ed58031"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_f380b8a58cfc4b71b86681885ed58031", "adminURL": "http://10.222.0.64:8080"}]}] May 23 15:41:34.298774 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant: tempest-VolumesNegativeTest-2101629547 May 23 15:41:34.298774 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant-Id: f380b8a58cfc4b71b86681885ed58031 May 23 15:41:34.298774 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant-Name: tempest-VolumesNegativeTest-2101629547 May 23 15:41:34.298774 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User: tempest-VolumesNegativeTest-2101629547-project May 23 15:41:34.298774 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Domain-Id: default May 23 15:41:34.298774 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Domain-Name: Default May 23 15:41:34.298774 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Id: 48352fabb230456690e795d91115605b May 23 15:41:34.298774 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Name: tempest-VolumesNegativeTest-2101629547-project May 23 15:41:34.298774 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: method: May 23 15:41:34.298774 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: exception: Volume tempest-invalid-966893539 could not be found. May 23 15:41:34.298774 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: action_args: {'id': 'tempest-invalid-966893539'} May 23 15:41:34.298774 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:41:34.300019 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:41:34.300019 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 15:41:34.300019 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 15:41:34.300019 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 23 15:41:34.300019 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 23 15:41:34.300019 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 23 15:41:34.300019 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 23 15:41:34.300019 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 23 15:41:34.300019 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 23 15:41:34.300019 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 23 15:41:34.300019 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 23 15:41:34.300019 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 15:41:34.300019 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 15:41:34.300019 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 15:41:34.300019 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 15:41:34.300019 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-966893539 could not be found. (HTTP 404) (Request-ID: req-a52713c8-5c74-4032-ad58-6fb6abcde17e) May 23 15:41:34.300019 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:41:34.300019 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:41:34.300019 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:41:34.301435 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:41:34.301435 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 23 15:41:34.301435 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 23 15:41:34.301435 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 15:41:34.301435 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 15:41:34.301435 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 23 15:41:34.301435 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 23 15:41:34.301435 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 15:41:34.301435 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 15:41:34.301435 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 15:41:34.301435 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 15:41:34.301435 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 23 15:41:34.301435 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 23 15:41:34.301435 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 23 15:41:34.301435 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 23 15:41:34.301435 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 23 15:41:34.301435 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 23 15:41:34.301435 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 23 15:41:34.301435 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 23 15:41:34.302907 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 15:41:34.302907 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 15:41:34.302907 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 15:41:34.302907 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 15:41:34.302907 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-966893539 could not be found. May 23 15:41:34.302907 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:41:34.302907 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:41:34.302907 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:41:34.302907 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:41:34.302907 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:41:34.302907 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:41:34.302907 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:41:34.302907 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:41:34.302907 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 15:41:34.302907 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 15:41:34.302907 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:41:34.302907 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:41:34.302907 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 23 15:41:34.302907 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:41:34.302907 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-966893539 could not be found. May 23 15:41:34.304225 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:41:34.304225 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:41:34.304225 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:41:34.304225 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:41:34.304225 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:41:34.304225 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:41:34.304225 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:41:34.304225 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:41:34.304225 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-966893539 could not be found. May 23 15:41:34.304225 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:41:34.304225 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-731cf670-a17b-4590-b83c-e0b2283b3122 tempest-VolumesNegativeTest-2101629547 tempest-VolumesNegativeTest-2101629547-project] Returning 404 to user: Volume tempest-invalid-966893539 could not be found. {{(pid=124933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:41:34.304225 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-731cf670-a17b-4590-b83c-e0b2283b3122 tempest-VolumesNegativeTest-2101629547 tempest-VolumesNegativeTest-2101629547-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/tempest-invalid-966893539" status: 404 len: 98 microversion: 2.1 time: 0.962658 May 23 15:41:34.304225 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 4/4] 10.222.0.64 () {58 vars in 1214 bytes} [Mon May 23 15:41:33 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-966893539 => generated 98 bytes in 969 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 23 15:41:34.307178 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-ea2ad509-378c-43a5-bac3-d5ccdec472d1 tempest-VolumesNegativeTest-2101629547 tempest-VolumesNegativeTest-2101629547-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004668 May 23 15:41:34.312837 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 5/5] 10.222.0.64 () {58 vars in 1139 bytes} [Mon May 23 15:41:34 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 23 15:41:34.318006 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-fc98d1da-c154-4f9a-aa0c-49dbf447ccaf tempest-VolumesNegativeTest-2101629547 tempest-VolumesNegativeTest-2101629547-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004296 May 23 15:41:34.322848 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 6/6] 10.222.0.64 () {58 vars in 1136 bytes} [Mon May 23 15:41:34 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 23 15:41:34.329909 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-12ae26b2-b825-4faa-b6d8-bc587740831e tempest-VolumesNegativeTest-2101629547 tempest-VolumesNegativeTest-2101629547-project] Calling method '.version_select at 0x7fab53ce20d0>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:34.413966 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.wsgi [None req-12ae26b2-b825-4faa-b6d8-bc587740831e tempest-VolumesNegativeTest-2101629547 tempest-VolumesNegativeTest-2101629547-project] HTTP exception thrown: Volume 7745f2b6-c1c5-45b7-b503-d92da15a2d20 could not be found. May 23 15:41:34.416799 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-12ae26b2-b825-4faa-b6d8-bc587740831e tempest-VolumesNegativeTest-2101629547 tempest-VolumesNegativeTest-2101629547-project] Request method failure captured: May 23 15:41:34.416799 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: request: DELETE /compute/v2.1/os-volumes/7745f2b6-c1c5-45b7-b503-d92da15a2d20 HTTP/1.1 May 23 15:41:34.416799 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Accept: application/json May 23 15:41:34.416799 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Accept-Encoding: identity May 23 15:41:34.416799 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Connection: close May 23 15:41:34.416799 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Content-Length: 0 May 23 15:41:34.416799 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Content-Type: application/json May 23 15:41:34.416799 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Host: 10.222.0.64 May 23 15:41:34.416799 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Openstack-System-Scope: None May 23 15:41:34.416799 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: User-Agent: python-urllib3/1.26.9 May 23 15:41:34.416799 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Auth-Token: gAAAAABii6ss8RanA61FXiaHPOrSLTb7WkznhOQarIufM_jCHQX6W4kE9lpvhYI3BskRuxjJ_ptYPU2uImjbi6acFrye-FNthMMjId_jxsA1BWzv0bap6QHYuIXYgXYH3qjKb54hk9-DSSgJO96xhe0FGFlqB2MHor55MQfiw6KIPiRL_3Istcw May 23 15:41:34.416799 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Domain-Id: None May 23 15:41:34.416799 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Domain-Name: None May 23 15:41:34.416799 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Identity-Status: Confirmed May 23 15:41:34.416799 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Is-Admin-Project: True May 23 15:41:34.416799 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Domain-Id: default May 23 15:41:34.416799 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Domain-Name: Default May 23 15:41:34.416799 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Id: f380b8a58cfc4b71b86681885ed58031 May 23 15:41:34.416799 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Name: tempest-VolumesNegativeTest-2101629547 May 23 15:41:34.416799 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Role: reader,member May 23 15:41:34.416799 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Roles: reader,member May 23 15:41:34.418400 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f380b8a58cfc4b71b86681885ed58031"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/f380b8a58cfc4b71b86681885ed58031"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f380b8a58cfc4b71b86681885ed58031"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_f380b8a58cfc4b71b86681885ed58031", "adminURL": "http://10.222.0.64:8080"}]}] May 23 15:41:34.418400 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant: tempest-VolumesNegativeTest-2101629547 May 23 15:41:34.418400 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant-Id: f380b8a58cfc4b71b86681885ed58031 May 23 15:41:34.418400 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant-Name: tempest-VolumesNegativeTest-2101629547 May 23 15:41:34.418400 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User: tempest-VolumesNegativeTest-2101629547-project May 23 15:41:34.418400 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Domain-Id: default May 23 15:41:34.418400 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Domain-Name: Default May 23 15:41:34.418400 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Id: 48352fabb230456690e795d91115605b May 23 15:41:34.418400 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Name: tempest-VolumesNegativeTest-2101629547-project May 23 15:41:34.418400 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: method: May 23 15:41:34.418400 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: exception: Volume 7745f2b6-c1c5-45b7-b503-d92da15a2d20 could not be found. May 23 15:41:34.418400 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: action_args: {'id': '7745f2b6-c1c5-45b7-b503-d92da15a2d20'} May 23 15:41:34.418400 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:41:34.419313 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:41:34.419313 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 15:41:34.419313 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 15:41:34.419313 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 23 15:41:34.419313 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 23 15:41:34.419313 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 23 15:41:34.419313 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 23 15:41:34.419313 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 23 15:41:34.419313 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 23 15:41:34.419313 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 23 15:41:34.419313 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 23 15:41:34.419313 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 15:41:34.419313 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 15:41:34.419313 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 15:41:34.419313 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 15:41:34.419313 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7745f2b6-c1c5-45b7-b503-d92da15a2d20 could not be found. (HTTP 404) (Request-ID: req-dddbe068-7c41-4034-8901-5ceced8d992f) May 23 15:41:34.419313 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:41:34.419313 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:41:34.419313 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:41:34.420535 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:41:34.420535 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 23 15:41:34.420535 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 23 15:41:34.420535 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 15:41:34.420535 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 15:41:34.420535 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 23 15:41:34.420535 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 23 15:41:34.420535 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 15:41:34.420535 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 15:41:34.420535 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 15:41:34.420535 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 15:41:34.420535 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 23 15:41:34.420535 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 23 15:41:34.420535 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 23 15:41:34.420535 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 23 15:41:34.420535 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 23 15:41:34.420535 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 23 15:41:34.420535 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 23 15:41:34.420535 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 23 15:41:34.428366 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 15:41:34.428366 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 15:41:34.428366 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 15:41:34.428366 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 15:41:34.428366 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7745f2b6-c1c5-45b7-b503-d92da15a2d20 could not be found. May 23 15:41:34.428366 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:41:34.428366 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:41:34.428366 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:41:34.428366 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:41:34.428366 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:41:34.428366 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:41:34.428366 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:41:34.428366 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:41:34.428366 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 15:41:34.428366 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 15:41:34.428366 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:41:34.428366 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:41:34.428366 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 23 15:41:34.428366 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:41:34.431471 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7745f2b6-c1c5-45b7-b503-d92da15a2d20 could not be found. May 23 15:41:34.431471 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:41:34.431471 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:41:34.431471 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:41:34.431471 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:41:34.431471 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:41:34.431471 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:41:34.431471 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:41:34.431471 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:41:34.431471 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7745f2b6-c1c5-45b7-b503-d92da15a2d20 could not be found. May 23 15:41:34.431471 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:41:34.431471 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-12ae26b2-b825-4faa-b6d8-bc587740831e tempest-VolumesNegativeTest-2101629547 tempest-VolumesNegativeTest-2101629547-project] Returning 404 to user: Volume 7745f2b6-c1c5-45b7-b503-d92da15a2d20 could not be found. {{(pid=124933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:41:34.431471 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-12ae26b2-b825-4faa-b6d8-bc587740831e tempest-VolumesNegativeTest-2101629547 tempest-VolumesNegativeTest-2101629547-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/7745f2b6-c1c5-45b7-b503-d92da15a2d20" status: 404 len: 109 microversion: 2.1 time: 0.100545 May 23 15:41:34.431471 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 7/7] 10.222.0.64 () {58 vars in 1247 bytes} [Mon May 23 15:41:34 2022] DELETE /compute/v2.1/os-volumes/7745f2b6-c1c5-45b7-b503-d92da15a2d20 => generated 109 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 15:41:34.442194 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-a9ee52b0-cbe7-4acf-89ad-d922250e7221 tempest-VolumesNegativeTest-2101629547 tempest-VolumesNegativeTest-2101629547-project] Calling method '.version_select at 0x7fab53ce23a0>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:34.490502 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.wsgi [None req-a9ee52b0-cbe7-4acf-89ad-d922250e7221 tempest-VolumesNegativeTest-2101629547 tempest-VolumesNegativeTest-2101629547-project] HTTP exception thrown: Volume 7adbabb9-0622-46fc-8539-e8890b305149 could not be found. May 23 15:41:34.493084 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-a9ee52b0-cbe7-4acf-89ad-d922250e7221 tempest-VolumesNegativeTest-2101629547 tempest-VolumesNegativeTest-2101629547-project] Request method failure captured: May 23 15:41:34.493084 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: request: GET /compute/v2.1/os-volumes/7adbabb9-0622-46fc-8539-e8890b305149 HTTP/1.1 May 23 15:41:34.493084 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Accept: application/json May 23 15:41:34.493084 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Accept-Encoding: identity May 23 15:41:34.493084 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Connection: close May 23 15:41:34.493084 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Content-Length: 0 May 23 15:41:34.493084 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Content-Type: application/json May 23 15:41:34.493084 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Host: 10.222.0.64 May 23 15:41:34.493084 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Openstack-System-Scope: None May 23 15:41:34.493084 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: User-Agent: python-urllib3/1.26.9 May 23 15:41:34.493084 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Auth-Token: gAAAAABii6ss8RanA61FXiaHPOrSLTb7WkznhOQarIufM_jCHQX6W4kE9lpvhYI3BskRuxjJ_ptYPU2uImjbi6acFrye-FNthMMjId_jxsA1BWzv0bap6QHYuIXYgXYH3qjKb54hk9-DSSgJO96xhe0FGFlqB2MHor55MQfiw6KIPiRL_3Istcw May 23 15:41:34.493084 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Domain-Id: None May 23 15:41:34.493084 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Domain-Name: None May 23 15:41:34.493084 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Identity-Status: Confirmed May 23 15:41:34.493084 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Is-Admin-Project: True May 23 15:41:34.493084 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Domain-Id: default May 23 15:41:34.493084 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Domain-Name: Default May 23 15:41:34.493084 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Id: f380b8a58cfc4b71b86681885ed58031 May 23 15:41:34.493084 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Name: tempest-VolumesNegativeTest-2101629547 May 23 15:41:34.493084 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Role: reader,member May 23 15:41:34.493084 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Roles: reader,member May 23 15:41:34.500855 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f380b8a58cfc4b71b86681885ed58031"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/f380b8a58cfc4b71b86681885ed58031"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f380b8a58cfc4b71b86681885ed58031"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_f380b8a58cfc4b71b86681885ed58031", "adminURL": "http://10.222.0.64:8080"}]}] May 23 15:41:34.500855 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant: tempest-VolumesNegativeTest-2101629547 May 23 15:41:34.500855 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant-Id: f380b8a58cfc4b71b86681885ed58031 May 23 15:41:34.500855 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant-Name: tempest-VolumesNegativeTest-2101629547 May 23 15:41:34.500855 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User: tempest-VolumesNegativeTest-2101629547-project May 23 15:41:34.500855 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Domain-Id: default May 23 15:41:34.500855 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Domain-Name: Default May 23 15:41:34.500855 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Id: 48352fabb230456690e795d91115605b May 23 15:41:34.500855 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Name: tempest-VolumesNegativeTest-2101629547-project May 23 15:41:34.500855 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: method: May 23 15:41:34.500855 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: exception: Volume 7adbabb9-0622-46fc-8539-e8890b305149 could not be found. May 23 15:41:34.500855 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: action_args: {'id': '7adbabb9-0622-46fc-8539-e8890b305149'} May 23 15:41:34.500855 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:41:34.501979 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:41:34.501979 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 15:41:34.501979 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 15:41:34.501979 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 15:41:34.501979 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 15:41:34.501979 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 15:41:34.501979 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 15:41:34.501979 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 15:41:34.501979 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 15:41:34.501979 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 15:41:34.501979 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 15:41:34.501979 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 15:41:34.501979 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 15:41:34.501979 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 15:41:34.501979 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 15:41:34.501979 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7adbabb9-0622-46fc-8539-e8890b305149 could not be found. (HTTP 404) (Request-ID: req-dd9da2c3-b877-4220-9516-207d43fd032f) May 23 15:41:34.501979 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:41:34.501979 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:41:34.501979 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:41:34.503142 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:41:34.503142 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 23 15:41:34.503142 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 23 15:41:34.503142 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 15:41:34.503142 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 15:41:34.503142 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 23 15:41:34.503142 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 23 15:41:34.503142 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 15:41:34.503142 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 15:41:34.503142 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 15:41:34.503142 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 15:41:34.503142 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 15:41:34.503142 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 15:41:34.503142 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 15:41:34.503142 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 15:41:34.503142 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 15:41:34.503142 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 15:41:34.503142 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 15:41:34.503142 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 15:41:34.504487 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 15:41:34.504487 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 15:41:34.504487 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 15:41:34.504487 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 15:41:34.504487 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7adbabb9-0622-46fc-8539-e8890b305149 could not be found. May 23 15:41:34.504487 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:41:34.504487 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:41:34.504487 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:41:34.504487 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:41:34.504487 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:41:34.504487 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:41:34.504487 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:41:34.504487 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:41:34.504487 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 15:41:34.504487 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 15:41:34.504487 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:41:34.504487 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:41:34.504487 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 23 15:41:34.504487 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:41:34.732266 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7adbabb9-0622-46fc-8539-e8890b305149 could not be found. May 23 15:41:34.732266 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:41:34.732266 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:41:34.732266 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:41:34.732266 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:41:34.732266 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:41:34.732266 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:41:34.732266 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:41:34.732266 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:41:34.732266 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7adbabb9-0622-46fc-8539-e8890b305149 could not be found. May 23 15:41:34.732266 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:41:34.732266 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-a9ee52b0-cbe7-4acf-89ad-d922250e7221 tempest-VolumesNegativeTest-2101629547 tempest-VolumesNegativeTest-2101629547-project] Returning 404 to user: Volume 7adbabb9-0622-46fc-8539-e8890b305149 could not be found. {{(pid=124933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:41:34.732266 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-a9ee52b0-cbe7-4acf-89ad-d922250e7221 tempest-VolumesNegativeTest-2101629547 tempest-VolumesNegativeTest-2101629547-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/7adbabb9-0622-46fc-8539-e8890b305149" status: 404 len: 109 microversion: 2.1 time: 0.060504 May 23 15:41:34.732266 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 8/8] 10.222.0.64 () {58 vars in 1244 bytes} [Mon May 23 15:41:34 2022] GET /compute/v2.1/os-volumes/7adbabb9-0622-46fc-8539-e8890b305149 => generated 109 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 15:41:35.338211 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-c47583e3-25ef-4b7c-9a0c-4df6348d9339 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-365607631", "imageRef": "a5c8503f-3733-426f-8a5b-c7c9358e4a45", "flavorRef": "452", "networks": [{"uuid": "c4853812-24f1-4eab-961f-8a8760bf5020"}]}} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:41:35.515764 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.network.neutron [None req-c47583e3-25ef-4b7c-9a0c-4df6348d9339 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] validate_networks() for [('c4853812-24f1-4eab-961f-8a8760bf5020', None, None, None, None, None)] {{(pid=124933) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 15:41:36.009287 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-08bce52e-9326-4c41-ad71-860bd4601684 tempest-VolumesSnapshotsTestJSON-1379251994 tempest-VolumesSnapshotsTestJSON-1379251994-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.717644 May 23 15:41:36.009933 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 1/9] 10.222.0.64 () {60 vars in 1154 bytes} [Mon May 23 15:41:32 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3720 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 23 15:41:36.022835 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-a51b1d50-5c1d-454c-97d1-effd421f6254 tempest-VolumesSnapshotsTestJSON-1379251994 tempest-VolumesSnapshotsTestJSON-1379251994-project] Calling method '.version_select at 0x7fab53d4eb80>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:36.149088 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-a51b1d50-5c1d-454c-97d1-effd421f6254 tempest-VolumesSnapshotsTestJSON-1379251994 tempest-VolumesSnapshotsTestJSON-1379251994-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/921ba662-b07e-4a98-9a81-ecb52694224a" status: 200 len: 344 microversion: 2.1 time: 0.130324 May 23 15:41:36.149697 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 2/10] 10.222.0.64 () {58 vars in 1244 bytes} [Mon May 23 15:41:36 2022] GET /compute/v2.1/os-volumes/921ba662-b07e-4a98-9a81-ecb52694224a => generated 344 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:41:36.735130 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.virt.hardware [None req-c47583e3-25ef-4b7c-9a0c-4df6348d9339 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Flavor limits 0:0:0 {{(pid=124933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 15:41:36.736153 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.virt.hardware [None req-c47583e3-25ef-4b7c-9a0c-4df6348d9339 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Image limits 0:0:0 {{(pid=124933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 15:41:36.738388 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.virt.hardware [None req-c47583e3-25ef-4b7c-9a0c-4df6348d9339 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Flavor pref 0:0:0 {{(pid=124933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 15:41:36.738388 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.virt.hardware [None req-c47583e3-25ef-4b7c-9a0c-4df6348d9339 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Image pref 0:0:0 {{(pid=124933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 15:41:36.738388 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.virt.hardware [None req-c47583e3-25ef-4b7c-9a0c-4df6348d9339 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 15:41:36.754950 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c47583e3-25ef-4b7c-9a0c-4df6348d9339 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:36.755513 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c47583e3-25ef-4b7c-9a0c-4df6348d9339 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:36.756468 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c47583e3-25ef-4b7c-9a0c-4df6348d9339 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:36.757053 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c47583e3-25ef-4b7c-9a0c-4df6348d9339 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:36.824420 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.quota [None req-c47583e3-25ef-4b7c-9a0c-4df6348d9339 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Getting quotas for project 0a819820263647f784079581c7527921. Resources: {'ram', 'instances', 'cores'} {{(pid=124933) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 15:41:36.833154 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.quota [None req-c47583e3-25ef-4b7c-9a0c-4df6348d9339 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Getting quotas for user 916c7e4c45a94167ba39db8c7fec0d19 and project 0a819820263647f784079581c7527921. Resources: {'ram', 'instances', 'cores'} {{(pid=124933) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 15:41:36.846002 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-c47583e3-25ef-4b7c-9a0c-4df6348d9339 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Going to run 1 instances... {{(pid=124933) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 15:41:36.848744 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-c47583e3-25ef-4b7c-9a0c-4df6348d9339 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] [instance: e30f4234-a3e5-4cf3-8d65-583de8fbca41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5c8503f-3733-426f-8a5b-c7c9358e4a45',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124933) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 15:41:37.001405 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-c47583e3-25ef-4b7c-9a0c-4df6348d9339 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.773928 May 23 15:41:37.007058 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 9/11] 10.222.0.64 () {60 vars in 1146 bytes} [Mon May 23 15:41:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 15:41:37.016444 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-7d20d325-ea30-48e3-b2a5-ea48c1ea51e5 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:37.017237 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-7d20d325-ea30-48e3-b2a5-ea48c1ea51e5 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] [instance: e30f4234-a3e5-4cf3-8d65-583de8fbca41] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:41:37.162867 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-557376fb-86f7-4038-a0c2-82f6f779435a tempest-VolumesSnapshotsTestJSON-1379251994 tempest-VolumesSnapshotsTestJSON-1379251994-project] Calling method '.version_select at 0x7fab533d7ca0>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:37.239090 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-7d20d325-ea30-48e3-b2a5-ea48c1ea51e5 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916c7e4c45a94167ba39db8c7fec0d19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a819820263647f784079581c7527921', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:41:37.258521 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-7d20d325-ea30-48e3-b2a5-ea48c1ea51e5 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] 10.222.0.64 "GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41" status: 200 len: 1214 microversion: 2.1 time: 0.247317 May 23 15:41:37.268464 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 3/12] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:41:37 2022] GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41 => generated 1214 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:41:37.302127 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-557376fb-86f7-4038-a0c2-82f6f779435a tempest-VolumesSnapshotsTestJSON-1379251994 tempest-VolumesSnapshotsTestJSON-1379251994-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/921ba662-b07e-4a98-9a81-ecb52694224a" status: 200 len: 344 microversion: 2.1 time: 0.143378 May 23 15:41:37.302686 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 10/13] 10.222.0.64 () {58 vars in 1244 bytes} [Mon May 23 15:41:37 2022] GET /compute/v2.1/os-volumes/921ba662-b07e-4a98-9a81-ecb52694224a => generated 344 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:41:38.283859 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-d1e724f7-ec6c-4413-8660-d7fb062be49a tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:38.285086 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-d1e724f7-ec6c-4413-8660-d7fb062be49a tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] [instance: e30f4234-a3e5-4cf3-8d65-583de8fbca41] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:41:38.317914 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-6f4f48fc-438d-4ad2-8b66-604dda7cecd5 tempest-VolumesSnapshotsTestJSON-1379251994 tempest-VolumesSnapshotsTestJSON-1379251994-project] Calling method '.version_select at 0x7fab533ef430>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:38.394152 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-d1e724f7-ec6c-4413-8660-d7fb062be49a tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916c7e4c45a94167ba39db8c7fec0d19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a819820263647f784079581c7527921', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:41:38.418503 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-d1e724f7-ec6c-4413-8660-d7fb062be49a tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] 10.222.0.64 "GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41" status: 200 len: 1214 microversion: 2.1 time: 0.143938 May 23 15:41:38.435178 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 4/14] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:41:38 2022] GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41 => generated 1214 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:41:38.442402 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-6f4f48fc-438d-4ad2-8b66-604dda7cecd5 tempest-VolumesSnapshotsTestJSON-1379251994 tempest-VolumesSnapshotsTestJSON-1379251994-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/921ba662-b07e-4a98-9a81-ecb52694224a" status: 200 len: 345 microversion: 2.1 time: 0.131173 May 23 15:41:38.452590 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 11/15] 10.222.0.64 () {58 vars in 1244 bytes} [Mon May 23 15:41:38 2022] GET /compute/v2.1/os-volumes/921ba662-b07e-4a98-9a81-ecb52694224a => generated 345 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:41:38.456628 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-477ad725-4ebf-4e03-b132-71928c780cb7 tempest-VolumesSnapshotsTestJSON-1379251994 tempest-VolumesSnapshotsTestJSON-1379251994-project] Action: 'create', calling method: .version_select at 0x7fab53d28700>, body: {"snapshot": {"volume_id": "921ba662-b07e-4a98-9a81-ecb52694224a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1646861218"}} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:41:39.318387 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-477ad725-4ebf-4e03-b132-71928c780cb7 tempest-VolumesSnapshotsTestJSON-1379251994 tempest-VolumesSnapshotsTestJSON-1379251994-project] 10.222.0.64 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.866906 May 23 15:41:39.319938 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 5/16] 10.222.0.64 () {60 vars in 1161 bytes} [Mon May 23 15:41:38 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:41:39.331079 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-a6cbfaa3-b444-42d8-a89b-1f0f5c62f9a3 tempest-VolumesSnapshotsTestJSON-1379251994 tempest-VolumesSnapshotsTestJSON-1379251994-project] Calling method '.version_select at 0x7fab533d7d30>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:39.415343 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-a6cbfaa3-b444-42d8-a89b-1f0f5c62f9a3 tempest-VolumesSnapshotsTestJSON-1379251994 tempest-VolumesSnapshotsTestJSON-1379251994-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/0ea28574-63b0-4d46-a0b9-0daacda1c546" status: 200 len: 287 microversion: 2.1 time: 0.087537 May 23 15:41:39.416146 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 12/17] 10.222.0.64 () {58 vars in 1250 bytes} [Mon May 23 15:41:39 2022] GET /compute/v2.1/os-snapshots/0ea28574-63b0-4d46-a0b9-0daacda1c546 => generated 287 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:41:39.428007 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-5b377161-81ee-4fac-9ffe-baee277d91be tempest-VolumesSnapshotsTestJSON-1379251994 tempest-VolumesSnapshotsTestJSON-1379251994-project] Calling method '.version_select at 0x7fab53d34820>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:39.435835 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-e0c9b791-1dcf-4efb-9ffb-29faa11361ad tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:39.437404 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-e0c9b791-1dcf-4efb-9ffb-29faa11361ad tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] [instance: e30f4234-a3e5-4cf3-8d65-583de8fbca41] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:41:39.487265 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-5b377161-81ee-4fac-9ffe-baee277d91be tempest-VolumesSnapshotsTestJSON-1379251994 tempest-VolumesSnapshotsTestJSON-1379251994-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.064488 May 23 15:41:39.488016 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 6/18] 10.222.0.64 () {58 vars in 1139 bytes} [Mon May 23 15:41:39 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:41:39.500396 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-c73d1ff5-d169-467d-8f12-775ce8322ff8 tempest-VolumesSnapshotsTestJSON-1379251994 tempest-VolumesSnapshotsTestJSON-1379251994-project] Calling method '.version_select at 0x7fab53d28a60>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:39.570517 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-e0c9b791-1dcf-4efb-9ffb-29faa11361ad tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916c7e4c45a94167ba39db8c7fec0d19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a819820263647f784079581c7527921', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:41:39.576304 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-c73d1ff5-d169-467d-8f12-775ce8322ff8 tempest-VolumesSnapshotsTestJSON-1379251994 tempest-VolumesSnapshotsTestJSON-1379251994-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/0ea28574-63b0-4d46-a0b9-0daacda1c546" status: 200 len: 287 microversion: 2.1 time: 0.081408 May 23 15:41:39.581496 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 7/19] 10.222.0.64 () {58 vars in 1250 bytes} [Mon May 23 15:41:39 2022] GET /compute/v2.1/os-snapshots/0ea28574-63b0-4d46-a0b9-0daacda1c546 => generated 287 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:41:39.591048 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-e0c9b791-1dcf-4efb-9ffb-29faa11361ad tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] 10.222.0.64 "GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41" status: 200 len: 1214 microversion: 2.1 time: 0.159085 May 23 15:41:39.592475 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 13/20] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:41:39 2022] GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41 => generated 1214 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:41:40.587727 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-68c630c9-ca6b-44ea-86ea-a94ba62df3ef tempest-VolumesSnapshotsTestJSON-1379251994 tempest-VolumesSnapshotsTestJSON-1379251994-project] Calling method '.version_select at 0x7fab53d12160>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:40.612281 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-5e673093-0daf-4acb-a754-6b3c6c5ac490 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:40.613799 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-5e673093-0daf-4acb-a754-6b3c6c5ac490 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] [instance: e30f4234-a3e5-4cf3-8d65-583de8fbca41] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:41:40.635037 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-5e673093-0daf-4acb-a754-6b3c6c5ac490 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:40.644691 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-5e673093-0daf-4acb-a754-6b3c6c5ac490 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:40.646688 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-5e673093-0daf-4acb-a754-6b3c6c5ac490 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:40.647796 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-5e673093-0daf-4acb-a754-6b3c6c5ac490 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:40.680623 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-68c630c9-ca6b-44ea-86ea-a94ba62df3ef tempest-VolumesSnapshotsTestJSON-1379251994 tempest-VolumesSnapshotsTestJSON-1379251994-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/0ea28574-63b0-4d46-a0b9-0daacda1c546" status: 200 len: 287 microversion: 2.1 time: 0.091250 May 23 15:41:40.680623 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 8/21] 10.222.0.64 () {58 vars in 1250 bytes} [Mon May 23 15:41:40 2022] GET /compute/v2.1/os-snapshots/0ea28574-63b0-4d46-a0b9-0daacda1c546 => generated 287 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:41:41.489611 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-5e673093-0daf-4acb-a754-6b3c6c5ac490 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916c7e4c45a94167ba39db8c7fec0d19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a819820263647f784079581c7527921', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:41:41.510985 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-5e673093-0daf-4acb-a754-6b3c6c5ac490 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] 10.222.0.64 "GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41" status: 200 len: 1218 microversion: 2.1 time: 0.906764 May 23 15:41:41.515994 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 14/22] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:41:40 2022] GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41 => generated 1218 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:41:41.689779 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-78bff711-ee80-46db-8011-787b62b3b4d7 tempest-VolumesSnapshotsTestJSON-1379251994 tempest-VolumesSnapshotsTestJSON-1379251994-project] Calling method '.version_select at 0x7fab53d34550>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:41.750503 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-78bff711-ee80-46db-8011-787b62b3b4d7 tempest-VolumesSnapshotsTestJSON-1379251994 tempest-VolumesSnapshotsTestJSON-1379251994-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/0ea28574-63b0-4d46-a0b9-0daacda1c546" status: 200 len: 287 microversion: 2.1 time: 0.065751 May 23 15:41:41.751486 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 9/23] 10.222.0.64 () {58 vars in 1250 bytes} [Mon May 23 15:41:41 2022] GET /compute/v2.1/os-snapshots/0ea28574-63b0-4d46-a0b9-0daacda1c546 => generated 287 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:41:42.535755 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-63ab5c03-90ce-4e35-840e-a7f273e00d2a tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:42.537575 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-63ab5c03-90ce-4e35-840e-a7f273e00d2a tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] [instance: e30f4234-a3e5-4cf3-8d65-583de8fbca41] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:41:42.547422 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-63ab5c03-90ce-4e35-840e-a7f273e00d2a tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:42.548148 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-63ab5c03-90ce-4e35-840e-a7f273e00d2a tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:42.550103 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-63ab5c03-90ce-4e35-840e-a7f273e00d2a tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:42.550708 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-63ab5c03-90ce-4e35-840e-a7f273e00d2a tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:42.746416 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-63ab5c03-90ce-4e35-840e-a7f273e00d2a tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916c7e4c45a94167ba39db8c7fec0d19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a819820263647f784079581c7527921', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:41:42.762985 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-0ae11076-416e-4555-8461-72c45d531151 tempest-VolumesSnapshotsTestJSON-1379251994 tempest-VolumesSnapshotsTestJSON-1379251994-project] Calling method '.version_select at 0x7fab53efcc10>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:42.766291 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-63ab5c03-90ce-4e35-840e-a7f273e00d2a tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] 10.222.0.64 "GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41" status: 200 len: 1218 microversion: 2.1 time: 0.236478 May 23 15:41:42.767857 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 15/24] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:41:42 2022] GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41 => generated 1218 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:41:42.837636 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-0ae11076-416e-4555-8461-72c45d531151 tempest-VolumesSnapshotsTestJSON-1379251994 tempest-VolumesSnapshotsTestJSON-1379251994-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/0ea28574-63b0-4d46-a0b9-0daacda1c546" status: 200 len: 287 microversion: 2.1 time: 0.078267 May 23 15:41:42.838783 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 10/25] 10.222.0.64 () {58 vars in 1250 bytes} [Mon May 23 15:41:42 2022] GET /compute/v2.1/os-snapshots/0ea28574-63b0-4d46-a0b9-0daacda1c546 => generated 287 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:41:43.785976 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-b0bacc80-ef7e-4044-a556-ec837d77de5e tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:43.786760 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-b0bacc80-ef7e-4044-a556-ec837d77de5e tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] [instance: e30f4234-a3e5-4cf3-8d65-583de8fbca41] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:41:43.806674 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b0bacc80-ef7e-4044-a556-ec837d77de5e tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:43.815701 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b0bacc80-ef7e-4044-a556-ec837d77de5e tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:43.825739 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b0bacc80-ef7e-4044-a556-ec837d77de5e tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:43.826256 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b0bacc80-ef7e-4044-a556-ec837d77de5e tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:43.850100 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-9150adec-c172-4a50-85d9-dd2bcd7ccfec tempest-VolumesSnapshotsTestJSON-1379251994 tempest-VolumesSnapshotsTestJSON-1379251994-project] Calling method '.version_select at 0x7fab53d285e0>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:44.094593 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-b0bacc80-ef7e-4044-a556-ec837d77de5e tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916c7e4c45a94167ba39db8c7fec0d19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a819820263647f784079581c7527921', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:41:44.118435 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-b0bacc80-ef7e-4044-a556-ec837d77de5e tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] 10.222.0.64 "GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41" status: 200 len: 1210 microversion: 2.1 time: 0.337822 May 23 15:41:44.120351 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 16/26] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:41:43 2022] GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41 => generated 1210 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:41:44.172374 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-9150adec-c172-4a50-85d9-dd2bcd7ccfec tempest-VolumesSnapshotsTestJSON-1379251994 tempest-VolumesSnapshotsTestJSON-1379251994-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/0ea28574-63b0-4d46-a0b9-0daacda1c546" status: 200 len: 287 microversion: 2.1 time: 0.324910 May 23 15:41:44.173003 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 11/27] 10.222.0.64 () {58 vars in 1250 bytes} [Mon May 23 15:41:43 2022] GET /compute/v2.1/os-snapshots/0ea28574-63b0-4d46-a0b9-0daacda1c546 => generated 287 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:41:45.142615 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-68ccb21e-c35d-4b06-8a96-dfb317856341 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:45.152188 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-68ccb21e-c35d-4b06-8a96-dfb317856341 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] [instance: e30f4234-a3e5-4cf3-8d65-583de8fbca41] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:41:45.183748 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-74f214c0-1309-4976-bfea-de966ff605f3 tempest-VolumesSnapshotsTestJSON-1379251994 tempest-VolumesSnapshotsTestJSON-1379251994-project] Calling method '.version_select at 0x7fab53d28c10>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:45.193970 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-68ccb21e-c35d-4b06-8a96-dfb317856341 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:45.195648 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-68ccb21e-c35d-4b06-8a96-dfb317856341 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:45.197680 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-68ccb21e-c35d-4b06-8a96-dfb317856341 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:45.199553 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-68ccb21e-c35d-4b06-8a96-dfb317856341 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:45.250752 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-74f214c0-1309-4976-bfea-de966ff605f3 tempest-VolumesSnapshotsTestJSON-1379251994 tempest-VolumesSnapshotsTestJSON-1379251994-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/0ea28574-63b0-4d46-a0b9-0daacda1c546" status: 200 len: 287 microversion: 2.1 time: 0.070605 May 23 15:41:45.251711 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 12/28] 10.222.0.64 () {58 vars in 1250 bytes} [Mon May 23 15:41:45 2022] GET /compute/v2.1/os-snapshots/0ea28574-63b0-4d46-a0b9-0daacda1c546 => generated 287 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:41:45.363724 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-68ccb21e-c35d-4b06-8a96-dfb317856341 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916c7e4c45a94167ba39db8c7fec0d19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a819820263647f784079581c7527921', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:41:45.391667 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-68ccb21e-c35d-4b06-8a96-dfb317856341 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] 10.222.0.64 "GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41" status: 200 len: 1210 microversion: 2.1 time: 0.248867 May 23 15:41:45.392303 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 17/29] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:41:45 2022] GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41 => generated 1210 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:41:46.250568 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-a9444e2a-59a1-4df7-95e0-67ccc724eefe tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-409858733", "imageRef": "a5c8503f-3733-426f-8a5b-c7c9358e4a45", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:41:46.279451 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-bef2df6e-fc86-49ab-a150-cf37b7ecea95 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Action: 'create', calling method: .version_select at 0x7fab53d344c0>, body: {"keypair": {"name": "tempest-keypair-518645918", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKlL459CuI5l89Jn34/bycmok6qfbQQPhYC8wLVE9Qdr/Z3f6aQF+siMqC7tNV7etF8T7I4Stj2NTI96oxUaazdChb0efFqX01F0oLQvn3uCnE/gWkU5CQrVx0pHBmT5Aw=="}} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:41:46.310396 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.network.neutron [None req-a9444e2a-59a1-4df7-95e0-67ccc724eefe tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] validate_networks() for [('eeca0c6c-3155-49db-bdc5-95de249b904d', None, None, None, None, None)] {{(pid=124933) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 15:41:46.347322 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.quota [None req-bef2df6e-fc86-49ab-a150-cf37b7ecea95 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Getting quotas for project 8d7ac236cd4d414fb70eb8da6da53484. Resources: {'key_pairs'} {{(pid=124934) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 15:41:46.354630 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.quota [None req-bef2df6e-fc86-49ab-a150-cf37b7ecea95 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Getting quotas for user 5236a93fc3a84d27bf3d150e85eb2589 and project 8d7ac236cd4d414fb70eb8da6da53484. Resources: {'key_pairs'} {{(pid=124934) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 15:41:46.581632 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-bef2df6e-fc86-49ab-a150-cf37b7ecea95 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.690208 May 23 15:41:46.587851 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 13/30] 10.222.0.64 () {60 vars in 1158 bytes} [Mon May 23 15:41:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:41:46.593436 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-21daa151-4664-4d4b-9fcd-e75ca398c1ef tempest-VolumesSnapshotsTestJSON-1379251994 tempest-VolumesSnapshotsTestJSON-1379251994-project] Calling method '.version_select at 0x7fab53c88f70>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:46.656718 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-21daa151-4664-4d4b-9fcd-e75ca398c1ef tempest-VolumesSnapshotsTestJSON-1379251994 tempest-VolumesSnapshotsTestJSON-1379251994-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/0ea28574-63b0-4d46-a0b9-0daacda1c546" status: 200 len: 288 microversion: 2.1 time: 0.067731 May 23 15:41:46.658261 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 14/31] 10.222.0.64 () {58 vars in 1250 bytes} [Mon May 23 15:41:46 2022] GET /compute/v2.1/os-snapshots/0ea28574-63b0-4d46-a0b9-0daacda1c546 => generated 288 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:41:46.663177 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-d347967a-9eab-4d5c-b8ef-e1d1e8dbce6b tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:46.663854 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-d347967a-9eab-4d5c-b8ef-e1d1e8dbce6b tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] [instance: e30f4234-a3e5-4cf3-8d65-583de8fbca41] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:41:46.685238 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-d347967a-9eab-4d5c-b8ef-e1d1e8dbce6b tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:46.685720 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-d347967a-9eab-4d5c-b8ef-e1d1e8dbce6b tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:46.688808 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-d347967a-9eab-4d5c-b8ef-e1d1e8dbce6b tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:46.692085 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-d347967a-9eab-4d5c-b8ef-e1d1e8dbce6b tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:46.779205 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_cell0:SELECT=2 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:41:46.908146 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-d347967a-9eab-4d5c-b8ef-e1d1e8dbce6b tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916c7e4c45a94167ba39db8c7fec0d19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a819820263647f784079581c7527921', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:41:46.929903 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-d347967a-9eab-4d5c-b8ef-e1d1e8dbce6b tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] 10.222.0.64 "GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41" status: 200 len: 1266 microversion: 2.1 time: 0.270332 May 23 15:41:46.937205 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 15/32] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:41:46 2022] GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41 => generated 1266 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:41:46.945781 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-85fcb11b-93af-4ca8-be3a-735ffe6ae4cc tempest-VolumesSnapshotsTestJSON-1379251994 tempest-VolumesSnapshotsTestJSON-1379251994-project] Calling method '.version_select at 0x7fab533e9280>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:46.984940 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.virt.hardware [None req-a9444e2a-59a1-4df7-95e0-67ccc724eefe tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Flavor limits 0:0:0 {{(pid=124933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 15:41:46.988081 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.virt.hardware [None req-a9444e2a-59a1-4df7-95e0-67ccc724eefe tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Image limits 0:0:0 {{(pid=124933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 15:41:46.988081 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.virt.hardware [None req-a9444e2a-59a1-4df7-95e0-67ccc724eefe tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Flavor pref 0:0:0 {{(pid=124933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 15:41:46.988081 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.virt.hardware [None req-a9444e2a-59a1-4df7-95e0-67ccc724eefe tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Image pref 0:0:0 {{(pid=124933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 15:41:46.988081 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.virt.hardware [None req-a9444e2a-59a1-4df7-95e0-67ccc724eefe tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 15:41:46.999096 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a9444e2a-59a1-4df7-95e0-67ccc724eefe tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:47.001182 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a9444e2a-59a1-4df7-95e0-67ccc724eefe tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:47.007975 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a9444e2a-59a1-4df7-95e0-67ccc724eefe tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:47.008449 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a9444e2a-59a1-4df7-95e0-67ccc724eefe tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:47.029903 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.quota [None req-a9444e2a-59a1-4df7-95e0-67ccc724eefe tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Getting quotas for project 65483f2a0c914022b38e501691095c51. Resources: {'ram', 'instances', 'cores'} {{(pid=124933) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 15:41:47.044847 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.quota [None req-a9444e2a-59a1-4df7-95e0-67ccc724eefe tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Getting quotas for user a2f1d435732b4ff0a60599309c66eeb5 and project 65483f2a0c914022b38e501691095c51. Resources: {'ram', 'instances', 'cores'} {{(pid=124933) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 15:41:47.104227 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-a9444e2a-59a1-4df7-95e0-67ccc724eefe tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Going to run 1 instances... {{(pid=124933) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 15:41:47.107045 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-a9444e2a-59a1-4df7-95e0-67ccc724eefe tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: bbe72f52-c8f9-46ea-ae59-9d2fe0a49523] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5c8503f-3733-426f-8a5b-c7c9358e4a45',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124933) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 15:41:47.128009 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-85fcb11b-93af-4ca8-be3a-735ffe6ae4cc tempest-VolumesSnapshotsTestJSON-1379251994 tempest-VolumesSnapshotsTestJSON-1379251994-project] 10.222.0.64 "DELETE /compute/v2.1/os-snapshots/0ea28574-63b0-4d46-a0b9-0daacda1c546" status: 202 len: 0 microversion: 2.1 time: 0.195928 May 23 15:41:47.131860 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 16/33] 10.222.0.64 () {58 vars in 1253 bytes} [Mon May 23 15:41:46 2022] DELETE /compute/v2.1/os-snapshots/0ea28574-63b0-4d46-a0b9-0daacda1c546 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 15:41:47.138514 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-f2512b95-a128-481f-b585-c0b17414d960 tempest-VolumesSnapshotsTestJSON-1379251994 tempest-VolumesSnapshotsTestJSON-1379251994-project] Calling method '.version_select at 0x7fab5343c670>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:47.260379 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-f2512b95-a128-481f-b585-c0b17414d960 tempest-VolumesSnapshotsTestJSON-1379251994 tempest-VolumesSnapshotsTestJSON-1379251994-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/0ea28574-63b0-4d46-a0b9-0daacda1c546" status: 200 len: 287 microversion: 2.1 time: 0.126528 May 23 15:41:47.261005 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 17/34] 10.222.0.64 () {58 vars in 1250 bytes} [Mon May 23 15:41:47 2022] GET /compute/v2.1/os-snapshots/0ea28574-63b0-4d46-a0b9-0daacda1c546 => generated 287 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:41:47.307050 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-a9444e2a-59a1-4df7-95e0-67ccc724eefe tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.165110 May 23 15:41:47.313143 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 18/35] 10.222.0.64 () {60 vars in 1146 bytes} [Mon May 23 15:41:46 2022] POST /compute/v2.1/servers => generated 383 bytes in 1172 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 23 15:41:47.321042 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-96776748-6563-4210-8621-225e15d8b04f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:47.322268 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-96776748-6563-4210-8621-225e15d8b04f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: bbe72f52-c8f9-46ea-ae59-9d2fe0a49523] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:41:47.445606 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-96776748-6563-4210-8621-225e15d8b04f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:41:47.457665 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-96776748-6563-4210-8621-225e15d8b04f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523" status: 200 len: 1221 microversion: 2.1 time: 0.138418 May 23 15:41:47.460122 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 18/36] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:41:47 2022] GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523 => generated 1221 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:41:47.653960 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-758fe5f4-790a-47cd-a04b-00837af3ce4f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-504339655", "imageRef": "a5c8503f-3733-426f-8a5b-c7c9358e4a45", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:41:47.752922 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.network.neutron [None req-758fe5f4-790a-47cd-a04b-00837af3ce4f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] validate_networks() for [('eeca0c6c-3155-49db-bdc5-95de249b904d', None, None, None, None, None)] {{(pid=124933) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 15:41:47.953365 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-02173066-393b-4520-8920-f5cfcf94cc60 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:47.954035 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-02173066-393b-4520-8920-f5cfcf94cc60 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] [instance: e30f4234-a3e5-4cf3-8d65-583de8fbca41] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:41:47.968271 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-02173066-393b-4520-8920-f5cfcf94cc60 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:47.969273 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-02173066-393b-4520-8920-f5cfcf94cc60 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:47.971175 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-02173066-393b-4520-8920-f5cfcf94cc60 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:47.971883 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-02173066-393b-4520-8920-f5cfcf94cc60 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:48.161921 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-02173066-393b-4520-8920-f5cfcf94cc60 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916c7e4c45a94167ba39db8c7fec0d19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a819820263647f784079581c7527921', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:41:48.173593 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-02173066-393b-4520-8920-f5cfcf94cc60 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] 10.222.0.64 "GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41" status: 200 len: 1266 microversion: 2.1 time: 0.229735 May 23 15:41:48.174738 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 19/37] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:41:47 2022] GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41 => generated 1266 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:41:48.284239 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-97d9f8d0-68f4-4c38-897f-d7dbcd9e7c20 tempest-VolumesSnapshotsTestJSON-1379251994 tempest-VolumesSnapshotsTestJSON-1379251994-project] Calling method '.version_select at 0x7fab5343c4c0>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:48.345585 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-97d9f8d0-68f4-4c38-897f-d7dbcd9e7c20 tempest-VolumesSnapshotsTestJSON-1379251994 tempest-VolumesSnapshotsTestJSON-1379251994-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/0ea28574-63b0-4d46-a0b9-0daacda1c546" status: 200 len: 287 microversion: 2.1 time: 0.076171 May 23 15:41:48.348991 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 20/38] 10.222.0.64 () {58 vars in 1250 bytes} [Mon May 23 15:41:48 2022] GET /compute/v2.1/os-snapshots/0ea28574-63b0-4d46-a0b9-0daacda1c546 => generated 287 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:41:48.463883 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.virt.hardware [None req-758fe5f4-790a-47cd-a04b-00837af3ce4f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Flavor limits 0:0:0 {{(pid=124933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 15:41:48.464351 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.virt.hardware [None req-758fe5f4-790a-47cd-a04b-00837af3ce4f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Image limits 0:0:0 {{(pid=124933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 15:41:48.466710 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.virt.hardware [None req-758fe5f4-790a-47cd-a04b-00837af3ce4f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Flavor pref 0:0:0 {{(pid=124933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 15:41:48.466710 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.virt.hardware [None req-758fe5f4-790a-47cd-a04b-00837af3ce4f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Image pref 0:0:0 {{(pid=124933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 15:41:48.466710 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.virt.hardware [None req-758fe5f4-790a-47cd-a04b-00837af3ce4f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 15:41:48.477492 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-758fe5f4-790a-47cd-a04b-00837af3ce4f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:48.478493 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-758fe5f4-790a-47cd-a04b-00837af3ce4f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:48.479329 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-758fe5f4-790a-47cd-a04b-00837af3ce4f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:48.479805 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-758fe5f4-790a-47cd-a04b-00837af3ce4f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:48.504049 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.quota [None req-758fe5f4-790a-47cd-a04b-00837af3ce4f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Getting quotas for project 65483f2a0c914022b38e501691095c51. Resources: {'ram', 'instances', 'cores'} {{(pid=124933) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 15:41:48.507946 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.quota [None req-758fe5f4-790a-47cd-a04b-00837af3ce4f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Getting quotas for user a2f1d435732b4ff0a60599309c66eeb5 and project 65483f2a0c914022b38e501691095c51. Resources: {'ram', 'instances', 'cores'} {{(pid=124933) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 15:41:48.525285 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-758fe5f4-790a-47cd-a04b-00837af3ce4f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Going to run 1 instances... {{(pid=124933) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 15:41:48.527789 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-758fe5f4-790a-47cd-a04b-00837af3ce4f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5c8503f-3733-426f-8a5b-c7c9358e4a45',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124933) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 15:41:48.706181 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-758fe5f4-790a-47cd-a04b-00837af3ce4f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.058372 May 23 15:41:48.706950 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 19/39] 10.222.0.64 () {60 vars in 1146 bytes} [Mon May 23 15:41:47 2022] POST /compute/v2.1/servers => generated 383 bytes in 1061 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 15:41:48.718756 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-c2d00d9c-b6ed-4c18-989e-bd2f32685ce9 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:48.719475 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-c2d00d9c-b6ed-4c18-989e-bd2f32685ce9 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:41:48.811216 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-c2d00d9c-b6ed-4c18-989e-bd2f32685ce9 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:41:48.819193 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-c2d00d9c-b6ed-4c18-989e-bd2f32685ce9 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 200 len: 1221 microversion: 2.1 time: 0.105327 May 23 15:41:48.824613 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 21/40] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:41:48 2022] GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 1221 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:41:49.192607 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-f1569343-3262-42a8-9969-f3f619d25ab0 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:49.193369 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-f1569343-3262-42a8-9969-f3f619d25ab0 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] [instance: e30f4234-a3e5-4cf3-8d65-583de8fbca41] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:41:49.216598 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-f1569343-3262-42a8-9969-f3f619d25ab0 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:49.218922 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-f1569343-3262-42a8-9969-f3f619d25ab0 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:49.221514 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-f1569343-3262-42a8-9969-f3f619d25ab0 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:49.222249 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-f1569343-3262-42a8-9969-f3f619d25ab0 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:49.318849 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-f1569343-3262-42a8-9969-f3f619d25ab0 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916c7e4c45a94167ba39db8c7fec0d19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a819820263647f784079581c7527921', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:41:49.351256 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-f1569343-3262-42a8-9969-f3f619d25ab0 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] 10.222.0.64 "GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41" status: 200 len: 1266 microversion: 2.1 time: 0.162416 May 23 15:41:49.357380 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 20/41] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:41:49 2022] GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:41:49.360889 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-126f00fc-c134-417f-9fc3-e9daafbe773c tempest-VolumesSnapshotsTestJSON-1379251994 tempest-VolumesSnapshotsTestJSON-1379251994-project] Calling method '.version_select at 0x7fab53394790>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:49.414419 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-126f00fc-c134-417f-9fc3-e9daafbe773c tempest-VolumesSnapshotsTestJSON-1379251994 tempest-VolumesSnapshotsTestJSON-1379251994-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/0ea28574-63b0-4d46-a0b9-0daacda1c546" status: 200 len: 287 microversion: 2.1 time: 0.057270 May 23 15:41:49.415861 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 22/42] 10.222.0.64 () {58 vars in 1250 bytes} [Mon May 23 15:41:49 2022] GET /compute/v2.1/os-snapshots/0ea28574-63b0-4d46-a0b9-0daacda1c546 => generated 287 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:41:49.845053 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-f5436eac-ad51-4941-8ca6-c30db0b1076a tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:49.845817 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-f5436eac-ad51-4941-8ca6-c30db0b1076a tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:41:49.907614 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-f5436eac-ad51-4941-8ca6-c30db0b1076a tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:41:49.916074 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-f5436eac-ad51-4941-8ca6-c30db0b1076a tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 200 len: 1221 microversion: 2.1 time: 0.075875 May 23 15:41:49.917980 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 21/43] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:41:49 2022] GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 1221 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:41:50.367926 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-7972eda1-a0de-448d-8632-80fe1ae0747f tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:50.368554 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-7972eda1-a0de-448d-8632-80fe1ae0747f tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] [instance: e30f4234-a3e5-4cf3-8d65-583de8fbca41] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:41:50.376353 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-7972eda1-a0de-448d-8632-80fe1ae0747f tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:50.377047 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-7972eda1-a0de-448d-8632-80fe1ae0747f tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:50.377879 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-7972eda1-a0de-448d-8632-80fe1ae0747f tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:50.378426 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-7972eda1-a0de-448d-8632-80fe1ae0747f tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:50.437589 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-04274281-3026-4509-850e-57fa0cb56a68 tempest-VolumesSnapshotsTestJSON-1379251994 tempest-VolumesSnapshotsTestJSON-1379251994-project] Calling method '.version_select at 0x7fab52afb3a0>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:50.461700 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-7972eda1-a0de-448d-8632-80fe1ae0747f tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916c7e4c45a94167ba39db8c7fec0d19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a819820263647f784079581c7527921', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:41:50.472084 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-7972eda1-a0de-448d-8632-80fe1ae0747f tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] 10.222.0.64 "GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41" status: 200 len: 1274 microversion: 2.1 time: 0.107710 May 23 15:41:50.482022 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 23/44] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:41:50 2022] GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41 => generated 1274 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:41:50.486658 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-04274281-3026-4509-850e-57fa0cb56a68 tempest-VolumesSnapshotsTestJSON-1379251994 tempest-VolumesSnapshotsTestJSON-1379251994-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/0ea28574-63b0-4d46-a0b9-0daacda1c546" status: 200 len: 287 microversion: 2.1 time: 0.062548 May 23 15:41:50.487907 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 22/45] 10.222.0.64 () {58 vars in 1250 bytes} [Mon May 23 15:41:50 2022] GET /compute/v2.1/os-snapshots/0ea28574-63b0-4d46-a0b9-0daacda1c546 => generated 287 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:41:50.567954 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-0ec5a7bd-fad2-4eaa-8db7-ede472283e5c tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-719969514", "imageRef": "a5c8503f-3733-426f-8a5b-c7c9358e4a45", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "02514ff5-801e-4a1a-ba63-1d21a54e8a97"}], "security_groups": [{"name": "tempest-securitygroup--1055380552"}], "key_name": "tempest-keypair-518645918", "user_data": "}} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:41:50.773476 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.network.neutron [None req-0ec5a7bd-fad2-4eaa-8db7-ede472283e5c tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] validate_networks() for [('02514ff5-801e-4a1a-ba63-1d21a54e8a97', None, None, None, None, None)] {{(pid=124934) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 15:41:50.934946 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-8a929b44-dd78-4799-b520-7078c064a78a tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:50.936820 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-8a929b44-dd78-4799-b520-7078c064a78a tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:41:50.946836 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-8a929b44-dd78-4799-b520-7078c064a78a tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:50.947814 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-8a929b44-dd78-4799-b520-7078c064a78a tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:50.950308 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-8a929b44-dd78-4799-b520-7078c064a78a tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:50.951044 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-8a929b44-dd78-4799-b520-7078c064a78a tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:51.062541 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-8a929b44-dd78-4799-b520-7078c064a78a tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:41:51.085537 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-8a929b44-dd78-4799-b520-7078c064a78a tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 200 len: 1225 microversion: 2.1 time: 0.154860 May 23 15:41:51.090948 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 23/46] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:41:50 2022] GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 1225 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:41:51.492065 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-782476b8-1872-4610-857e-873eb431d2a1 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:51.492683 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-782476b8-1872-4610-857e-873eb431d2a1 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] [instance: e30f4234-a3e5-4cf3-8d65-583de8fbca41] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:41:51.498948 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-782476b8-1872-4610-857e-873eb431d2a1 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:51.499415 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-782476b8-1872-4610-857e-873eb431d2a1 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:51.500187 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-782476b8-1872-4610-857e-873eb431d2a1 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:51.507774 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-782476b8-1872-4610-857e-873eb431d2a1 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:51.604005 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-782476b8-1872-4610-857e-873eb431d2a1 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916c7e4c45a94167ba39db8c7fec0d19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a819820263647f784079581c7527921', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:41:51.612391 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-782476b8-1872-4610-857e-873eb431d2a1 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] 10.222.0.64 "GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41" status: 200 len: 1284 microversion: 2.1 time: 0.124204 May 23 15:41:51.612967 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 24/47] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:41:51 2022] GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41 => generated 1284 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:41:51.618708 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-821bd935-1023-4f46-a7a6-97993b7276a7 tempest-VolumesSnapshotsTestJSON-1379251994 tempest-VolumesSnapshotsTestJSON-1379251994-project] Calling method '.version_select at 0x7fab52afbb80>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:51.643825 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.virt.hardware [None req-0ec5a7bd-fad2-4eaa-8db7-ede472283e5c tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Flavor limits 0:0:0 {{(pid=124934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 15:41:51.644313 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.virt.hardware [None req-0ec5a7bd-fad2-4eaa-8db7-ede472283e5c tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Image limits 0:0:0 {{(pid=124934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 15:41:51.644711 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.virt.hardware [None req-0ec5a7bd-fad2-4eaa-8db7-ede472283e5c tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Flavor pref 0:0:0 {{(pid=124934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 15:41:51.645139 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.virt.hardware [None req-0ec5a7bd-fad2-4eaa-8db7-ede472283e5c tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Image pref 0:0:0 {{(pid=124934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 15:41:51.645550 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.virt.hardware [None req-0ec5a7bd-fad2-4eaa-8db7-ede472283e5c tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 15:41:51.653879 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-821bd935-1023-4f46-a7a6-97993b7276a7 tempest-VolumesSnapshotsTestJSON-1379251994 tempest-VolumesSnapshotsTestJSON-1379251994-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/0ea28574-63b0-4d46-a0b9-0daacda1c546" status: 200 len: 287 microversion: 2.1 time: 0.038634 May 23 15:41:51.655053 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 25/48] 10.222.0.64 () {58 vars in 1250 bytes} [Mon May 23 15:41:51 2022] GET /compute/v2.1/os-snapshots/0ea28574-63b0-4d46-a0b9-0daacda1c546 => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:41:51.655463 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0ec5a7bd-fad2-4eaa-8db7-ede472283e5c tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:51.656009 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0ec5a7bd-fad2-4eaa-8db7-ede472283e5c tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:51.656943 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0ec5a7bd-fad2-4eaa-8db7-ede472283e5c tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:51.657454 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0ec5a7bd-fad2-4eaa-8db7-ede472283e5c tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:51.681030 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.quota [None req-0ec5a7bd-fad2-4eaa-8db7-ede472283e5c tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Getting quotas for project 8d7ac236cd4d414fb70eb8da6da53484. Resources: {'ram', 'instances', 'cores'} {{(pid=124934) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 15:41:51.685572 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.quota [None req-0ec5a7bd-fad2-4eaa-8db7-ede472283e5c tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Getting quotas for user 5236a93fc3a84d27bf3d150e85eb2589 and project 8d7ac236cd4d414fb70eb8da6da53484. Resources: {'ram', 'instances', 'cores'} {{(pid=124934) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 15:41:51.703503 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-0ec5a7bd-fad2-4eaa-8db7-ede472283e5c tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Going to run 1 instances... {{(pid=124934) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 15:41:51.706885 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-0ec5a7bd-fad2-4eaa-8db7-ede472283e5c tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5c8503f-3733-426f-8a5b-c7c9358e4a45',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124934) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 15:41:51.836251 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-0ec5a7bd-fad2-4eaa-8db7-ede472283e5c tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.270267 May 23 15:41:51.836251 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 24/49] 10.222.0.64 () {60 vars in 1146 bytes} [Mon May 23 15:41:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 1272 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 15:41:51.845020 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-e3551708-c74e-40aa-832b-aa80fe1ef598 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:51.845708 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-e3551708-c74e-40aa-832b-aa80fe1ef598 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:41:51.921655 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-e3551708-c74e-40aa-832b-aa80fe1ef598 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:41:51.929897 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-e3551708-c74e-40aa-832b-aa80fe1ef598 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 200 len: 1236 microversion: 2.1 time: 0.089027 May 23 15:41:51.932362 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 26/50] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:41:51 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 1236 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:41:52.102665 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-0f416326-4009-4f6e-ab3f-89607ded00f4 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:52.103284 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-0f416326-4009-4f6e-ab3f-89607ded00f4 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:41:52.110413 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0f416326-4009-4f6e-ab3f-89607ded00f4 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:52.110876 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0f416326-4009-4f6e-ab3f-89607ded00f4 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:52.111653 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0f416326-4009-4f6e-ab3f-89607ded00f4 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:52.112106 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0f416326-4009-4f6e-ab3f-89607ded00f4 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:52.176448 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-0f416326-4009-4f6e-ab3f-89607ded00f4 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:41:52.182729 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-0f416326-4009-4f6e-ab3f-89607ded00f4 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 200 len: 1225 microversion: 2.1 time: 0.084184 May 23 15:41:52.183310 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 25/51] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:41:52 2022] GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:41:52.629708 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-94186d18-710e-4d03-aaf5-be944dc20425 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:52.630335 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-94186d18-710e-4d03-aaf5-be944dc20425 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] [instance: e30f4234-a3e5-4cf3-8d65-583de8fbca41] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:41:52.651547 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-94186d18-710e-4d03-aaf5-be944dc20425 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:52.652018 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-94186d18-710e-4d03-aaf5-be944dc20425 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:52.652815 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-94186d18-710e-4d03-aaf5-be944dc20425 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:52.653298 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-94186d18-710e-4d03-aaf5-be944dc20425 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:52.670877 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-2b3b285c-506a-4e20-b1e2-3feab635f475 tempest-VolumesSnapshotsTestJSON-1379251994 tempest-VolumesSnapshotsTestJSON-1379251994-project] Calling method '.version_select at 0x7fab533183a0>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:52.712592 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.wsgi [None req-2b3b285c-506a-4e20-b1e2-3feab635f475 tempest-VolumesSnapshotsTestJSON-1379251994 tempest-VolumesSnapshotsTestJSON-1379251994-project] HTTP exception thrown: Snapshot 0ea28574-63b0-4d46-a0b9-0daacda1c546 could not be found. May 23 15:41:52.717895 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-2b3b285c-506a-4e20-b1e2-3feab635f475 tempest-VolumesSnapshotsTestJSON-1379251994 tempest-VolumesSnapshotsTestJSON-1379251994-project] Request method failure captured: May 23 15:41:52.717895 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: request: GET /compute/v2.1/os-snapshots/0ea28574-63b0-4d46-a0b9-0daacda1c546 HTTP/1.1 May 23 15:41:52.717895 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Accept: application/json May 23 15:41:52.717895 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Accept-Encoding: identity May 23 15:41:52.717895 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Connection: close May 23 15:41:52.717895 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Content-Length: 0 May 23 15:41:52.717895 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Content-Type: application/json May 23 15:41:52.717895 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Host: 10.222.0.64 May 23 15:41:52.717895 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Openstack-System-Scope: None May 23 15:41:52.717895 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: User-Agent: python-urllib3/1.26.9 May 23 15:41:52.717895 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Auth-Token: gAAAAABii6ssbOvJA7-Tms1h7kkjjel3iEbcCefqxpGg1ZCxQ2dASD8Z61YTKGkX-eCOKKjLBwzDc2si_3dfFFoNvb1E9tMAIZ51KXV7JxY2OuP9MPqknavZoHM7xl2s9NPCoKdpdd26-J5rz4TLwVzyEUNJGM-ysZ4pGsaV4MiGI8FwkOTP604 May 23 15:41:52.717895 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Domain-Id: None May 23 15:41:52.717895 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Domain-Name: None May 23 15:41:52.717895 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Identity-Status: Confirmed May 23 15:41:52.717895 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Is-Admin-Project: True May 23 15:41:52.717895 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Domain-Id: default May 23 15:41:52.717895 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Domain-Name: Default May 23 15:41:52.717895 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Id: e3a7e6bce7fc48f996703cb5eb3533fb May 23 15:41:52.717895 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1379251994 May 23 15:41:52.717895 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Role: reader,member May 23 15:41:52.717895 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Roles: reader,member May 23 15:41:52.719124 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e3a7e6bce7fc48f996703cb5eb3533fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/e3a7e6bce7fc48f996703cb5eb3533fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e3a7e6bce7fc48f996703cb5eb3533fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_e3a7e6bce7fc48f996703cb5eb3533fb", "adminURL": "http://10.222.0.64:8080"}]}] May 23 15:41:52.719124 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1379251994 May 23 15:41:52.719124 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant-Id: e3a7e6bce7fc48f996703cb5eb3533fb May 23 15:41:52.719124 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1379251994 May 23 15:41:52.719124 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User: tempest-VolumesSnapshotsTestJSON-1379251994-project May 23 15:41:52.719124 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Domain-Id: default May 23 15:41:52.719124 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Domain-Name: Default May 23 15:41:52.719124 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Id: 49f723f9ef414cd79a6167dcd852ffe1 May 23 15:41:52.719124 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1379251994-project May 23 15:41:52.719124 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: method: May 23 15:41:52.719124 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: exception: Snapshot 0ea28574-63b0-4d46-a0b9-0daacda1c546 could not be found. May 23 15:41:52.719124 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: action_args: {'id': '0ea28574-63b0-4d46-a0b9-0daacda1c546'} May 23 15:41:52.719124 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:41:52.719789 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:41:52.719789 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 23 15:41:52.719789 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 23 15:41:52.719789 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 23 15:41:52.719789 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 23 15:41:52.719789 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 23 15:41:52.719789 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 23 15:41:52.719789 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 15:41:52.719789 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 15:41:52.719789 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 15:41:52.719789 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 15:41:52.719789 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 15:41:52.719789 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 15:41:52.719789 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 15:41:52.719789 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 15:41:52.719789 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 0ea28574-63b0-4d46-a0b9-0daacda1c546 could not be found. (HTTP 404) (Request-ID: req-c2cf2ffc-4bf4-43bc-b3ed-669cd0f7ee26) May 23 15:41:52.719789 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:41:52.719789 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:41:52.720690 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:41:52.720690 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:41:52.720690 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 23 15:41:52.720690 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 23 15:41:52.720690 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 15:41:52.720690 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 15:41:52.720690 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 23 15:41:52.720690 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 23 15:41:52.720690 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 15:41:52.720690 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 15:41:52.720690 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 23 15:41:52.720690 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 23 15:41:52.720690 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 23 15:41:52.720690 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 23 15:41:52.720690 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 23 15:41:52.720690 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 23 15:41:52.720690 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 15:41:52.720690 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 15:41:52.720690 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 15:41:52.721831 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 15:41:52.721831 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 15:41:52.721831 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 15:41:52.721831 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 15:41:52.721831 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 15:41:52.721831 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 0ea28574-63b0-4d46-a0b9-0daacda1c546 could not be found. May 23 15:41:52.721831 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:41:52.721831 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:41:52.721831 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:41:52.721831 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:41:52.721831 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:41:52.721831 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:41:52.721831 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:41:52.721831 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:41:52.721831 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 15:41:52.721831 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 15:41:52.721831 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:41:52.721831 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:41:52.721831 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 23 15:41:52.721831 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:41:52.722815 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 0ea28574-63b0-4d46-a0b9-0daacda1c546 could not be found. May 23 15:41:52.722815 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:41:52.722815 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:41:52.722815 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:41:52.722815 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:41:52.722815 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:41:52.722815 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:41:52.722815 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:41:52.722815 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:41:52.722815 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 0ea28574-63b0-4d46-a0b9-0daacda1c546 could not be found. May 23 15:41:52.722815 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:41:52.722815 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-2b3b285c-506a-4e20-b1e2-3feab635f475 tempest-VolumesSnapshotsTestJSON-1379251994 tempest-VolumesSnapshotsTestJSON-1379251994-project] Returning 404 to user: Snapshot 0ea28574-63b0-4d46-a0b9-0daacda1c546 could not be found. {{(pid=124934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:41:52.722815 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-2b3b285c-506a-4e20-b1e2-3feab635f475 tempest-VolumesSnapshotsTestJSON-1379251994 tempest-VolumesSnapshotsTestJSON-1379251994-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/0ea28574-63b0-4d46-a0b9-0daacda1c546" status: 404 len: 111 microversion: 2.1 time: 0.057424 May 23 15:41:52.725272 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 26/52] 10.222.0.64 () {58 vars in 1250 bytes} [Mon May 23 15:41:52 2022] GET /compute/v2.1/os-snapshots/0ea28574-63b0-4d46-a0b9-0daacda1c546 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 23 15:41:52.731811 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-2fb45326-73e3-4a57-9c13-6702accd8591 tempest-VolumesSnapshotsTestJSON-1379251994 tempest-VolumesSnapshotsTestJSON-1379251994-project] Calling method '.version_select at 0x7fab53d4eb80>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:52.765313 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-94186d18-710e-4d03-aaf5-be944dc20425 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916c7e4c45a94167ba39db8c7fec0d19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a819820263647f784079581c7527921', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:41:52.785093 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-94186d18-710e-4d03-aaf5-be944dc20425 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] 10.222.0.64 "GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41" status: 200 len: 1272 microversion: 2.1 time: 0.157505 May 23 15:41:52.786796 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 27/53] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:41:52 2022] GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41 => generated 1272 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:41:52.949523 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-02d78928-4147-406d-b863-d3ea48980c00 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:52.950146 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-02d78928-4147-406d-b863-d3ea48980c00 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:41:53.045410 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-02d78928-4147-406d-b863-d3ea48980c00 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:41:53.053721 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-02d78928-4147-406d-b863-d3ea48980c00 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 200 len: 1236 microversion: 2.1 time: 0.108358 May 23 15:41:53.054385 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 28/54] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:41:52 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 1236 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:41:53.141097 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-2fb45326-73e3-4a57-9c13-6702accd8591 tempest-VolumesSnapshotsTestJSON-1379251994 tempest-VolumesSnapshotsTestJSON-1379251994-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/921ba662-b07e-4a98-9a81-ecb52694224a" status: 202 len: 0 microversion: 2.1 time: 0.414879 May 23 15:41:53.141993 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 27/55] 10.222.0.64 () {58 vars in 1247 bytes} [Mon May 23 15:41:52 2022] DELETE /compute/v2.1/os-volumes/921ba662-b07e-4a98-9a81-ecb52694224a => generated 0 bytes in 417 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 15:41:53.151970 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-2fc0144e-050a-463d-9934-5387d88334cd tempest-VolumesSnapshotsTestJSON-1379251994 tempest-VolumesSnapshotsTestJSON-1379251994-project] Calling method '.version_select at 0x7fab52afbaf0>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:53.199595 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-9245b50c-d471-4179-abc2-7839d81ce617 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:53.200416 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-9245b50c-d471-4179-abc2-7839d81ce617 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:41:53.207347 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-9245b50c-d471-4179-abc2-7839d81ce617 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:53.207800 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-9245b50c-d471-4179-abc2-7839d81ce617 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:53.208606 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-9245b50c-d471-4179-abc2-7839d81ce617 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:53.210487 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-9245b50c-d471-4179-abc2-7839d81ce617 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:53.291423 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-9245b50c-d471-4179-abc2-7839d81ce617 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:41:53.310587 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-9245b50c-d471-4179-abc2-7839d81ce617 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 200 len: 1273 microversion: 2.1 time: 0.114841 May 23 15:41:53.313515 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 28/56] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:41:53 2022] GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 1273 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:41:53.376941 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-2fc0144e-050a-463d-9934-5387d88334cd tempest-VolumesSnapshotsTestJSON-1379251994 tempest-VolumesSnapshotsTestJSON-1379251994-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/921ba662-b07e-4a98-9a81-ecb52694224a" status: 200 len: 344 microversion: 2.1 time: 0.229979 May 23 15:41:53.377541 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 29/57] 10.222.0.64 () {58 vars in 1244 bytes} [Mon May 23 15:41:53 2022] GET /compute/v2.1/os-volumes/921ba662-b07e-4a98-9a81-ecb52694224a => generated 344 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:41:53.807504 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-d8d516bf-c542-49a5-bf97-d81b14e1ffbd tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:53.808047 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-d8d516bf-c542-49a5-bf97-d81b14e1ffbd tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] [instance: e30f4234-a3e5-4cf3-8d65-583de8fbca41] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:41:53.822100 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-d8d516bf-c542-49a5-bf97-d81b14e1ffbd tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:53.822627 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-d8d516bf-c542-49a5-bf97-d81b14e1ffbd tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:53.828780 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-d8d516bf-c542-49a5-bf97-d81b14e1ffbd tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:53.828780 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-d8d516bf-c542-49a5-bf97-d81b14e1ffbd tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:54.041080 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-d8d516bf-c542-49a5-bf97-d81b14e1ffbd tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916c7e4c45a94167ba39db8c7fec0d19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a819820263647f784079581c7527921', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:41:54.051226 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-d8d516bf-c542-49a5-bf97-d81b14e1ffbd tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] 10.222.0.64 "GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41" status: 200 len: 1314 microversion: 2.1 time: 0.248107 May 23 15:41:54.052301 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 29/58] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:41:53 2022] GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41 => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:41:54.077471 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-ffe58041-9f7a-4a7c-9037-a19719965722 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:54.078763 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-ffe58041-9f7a-4a7c-9037-a19719965722 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:41:54.086314 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ffe58041-9f7a-4a7c-9037-a19719965722 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:54.086755 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ffe58041-9f7a-4a7c-9037-a19719965722 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:54.087707 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ffe58041-9f7a-4a7c-9037-a19719965722 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:54.088372 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ffe58041-9f7a-4a7c-9037-a19719965722 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:54.210667 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-ffe58041-9f7a-4a7c-9037-a19719965722 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:41:54.220650 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-ffe58041-9f7a-4a7c-9037-a19719965722 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 200 len: 1232 microversion: 2.1 time: 0.147584 May 23 15:41:54.222715 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 30/59] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:41:54 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 1232 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:41:54.505094 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-e9925d71-68ad-4348-be48-eac627692feb tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:54.505094 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-e9925d71-68ad-4348-be48-eac627692feb tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:41:54.505094 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e9925d71-68ad-4348-be48-eac627692feb tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:54.505094 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e9925d71-68ad-4348-be48-eac627692feb tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:54.506039 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e9925d71-68ad-4348-be48-eac627692feb tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:54.506039 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e9925d71-68ad-4348-be48-eac627692feb tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:54.506194 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-6f67dfb4-8fd7-49d7-8311-8891ecf65230 tempest-VolumesSnapshotsTestJSON-1379251994 tempest-VolumesSnapshotsTestJSON-1379251994-project] Calling method '.version_select at 0x7fab52ac1d30>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:54.506283 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-e9925d71-68ad-4348-be48-eac627692feb tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:41:54.506283 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-e9925d71-68ad-4348-be48-eac627692feb tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 200 len: 1273 microversion: 2.1 time: 0.094892 May 23 15:41:54.506283 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 30/60] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:41:54 2022] GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 1273 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:41:55.080217 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-9a840090-e98e-4e73-aabe-8b5b7ccab792 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:55.088530 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-9a840090-e98e-4e73-aabe-8b5b7ccab792 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] [instance: e30f4234-a3e5-4cf3-8d65-583de8fbca41] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:41:55.088530 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-9a840090-e98e-4e73-aabe-8b5b7ccab792 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:55.089337 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-9a840090-e98e-4e73-aabe-8b5b7ccab792 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:55.090284 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-9a840090-e98e-4e73-aabe-8b5b7ccab792 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:55.090866 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-9a840090-e98e-4e73-aabe-8b5b7ccab792 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:55.241517 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-9a840090-e98e-4e73-aabe-8b5b7ccab792 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916c7e4c45a94167ba39db8c7fec0d19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a819820263647f784079581c7527921', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:41:55.249613 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-9a840090-e98e-4e73-aabe-8b5b7ccab792 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] 10.222.0.64 "GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41" status: 200 len: 1314 microversion: 2.1 time: 0.174119 May 23 15:41:55.250204 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 31/61] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:41:55 2022] GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:41:55.255739 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-7a4b79bc-42bd-4cf5-b6b4-10a37e3c65cd tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:55.257117 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-7a4b79bc-42bd-4cf5-b6b4-10a37e3c65cd tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:41:55.267776 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-7a4b79bc-42bd-4cf5-b6b4-10a37e3c65cd tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:55.268348 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-7a4b79bc-42bd-4cf5-b6b4-10a37e3c65cd tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:55.269240 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-7a4b79bc-42bd-4cf5-b6b4-10a37e3c65cd tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:55.269760 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-7a4b79bc-42bd-4cf5-b6b4-10a37e3c65cd tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:55.349598 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-7a4b79bc-42bd-4cf5-b6b4-10a37e3c65cd tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:41:55.357365 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-7a4b79bc-42bd-4cf5-b6b4-10a37e3c65cd tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 200 len: 1232 microversion: 2.1 time: 0.105873 May 23 15:41:55.367995 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 32/62] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:41:55 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 1232 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:41:55.546733 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-f8a6c491-c5f7-4737-ac5d-7d795ecc98c8 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:55.546733 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-f8a6c491-c5f7-4737-ac5d-7d795ecc98c8 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:41:55.546733 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-f8a6c491-c5f7-4737-ac5d-7d795ecc98c8 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:55.546733 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-f8a6c491-c5f7-4737-ac5d-7d795ecc98c8 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:55.547451 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-f8a6c491-c5f7-4737-ac5d-7d795ecc98c8 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:55.547451 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-f8a6c491-c5f7-4737-ac5d-7d795ecc98c8 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:55.580570 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.wsgi [None req-6f67dfb4-8fd7-49d7-8311-8891ecf65230 tempest-VolumesSnapshotsTestJSON-1379251994 tempest-VolumesSnapshotsTestJSON-1379251994-project] HTTP exception thrown: Volume 921ba662-b07e-4a98-9a81-ecb52694224a could not be found. May 23 15:41:55.583573 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-6f67dfb4-8fd7-49d7-8311-8891ecf65230 tempest-VolumesSnapshotsTestJSON-1379251994 tempest-VolumesSnapshotsTestJSON-1379251994-project] Request method failure captured: May 23 15:41:55.583573 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: request: GET /compute/v2.1/os-volumes/921ba662-b07e-4a98-9a81-ecb52694224a HTTP/1.1 May 23 15:41:55.583573 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Accept: application/json May 23 15:41:55.583573 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Accept-Encoding: identity May 23 15:41:55.583573 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Connection: close May 23 15:41:55.583573 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Content-Length: 0 May 23 15:41:55.583573 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Content-Type: application/json May 23 15:41:55.583573 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Host: 10.222.0.64 May 23 15:41:55.583573 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Openstack-System-Scope: None May 23 15:41:55.583573 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: User-Agent: python-urllib3/1.26.9 May 23 15:41:55.583573 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Auth-Token: gAAAAABii6ssbOvJA7-Tms1h7kkjjel3iEbcCefqxpGg1ZCxQ2dASD8Z61YTKGkX-eCOKKjLBwzDc2si_3dfFFoNvb1E9tMAIZ51KXV7JxY2OuP9MPqknavZoHM7xl2s9NPCoKdpdd26-J5rz4TLwVzyEUNJGM-ysZ4pGsaV4MiGI8FwkOTP604 May 23 15:41:55.583573 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Domain-Id: None May 23 15:41:55.583573 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Domain-Name: None May 23 15:41:55.583573 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Identity-Status: Confirmed May 23 15:41:55.583573 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Is-Admin-Project: True May 23 15:41:55.583573 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Domain-Id: default May 23 15:41:55.583573 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Domain-Name: Default May 23 15:41:55.583573 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Id: e3a7e6bce7fc48f996703cb5eb3533fb May 23 15:41:55.583573 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1379251994 May 23 15:41:55.583573 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Role: reader,member May 23 15:41:55.583573 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Roles: reader,member May 23 15:41:55.584956 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e3a7e6bce7fc48f996703cb5eb3533fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/e3a7e6bce7fc48f996703cb5eb3533fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e3a7e6bce7fc48f996703cb5eb3533fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_e3a7e6bce7fc48f996703cb5eb3533fb", "adminURL": "http://10.222.0.64:8080"}]}] May 23 15:41:55.584956 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1379251994 May 23 15:41:55.584956 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant-Id: e3a7e6bce7fc48f996703cb5eb3533fb May 23 15:41:55.584956 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1379251994 May 23 15:41:55.584956 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User: tempest-VolumesSnapshotsTestJSON-1379251994-project May 23 15:41:55.584956 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Domain-Id: default May 23 15:41:55.584956 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Domain-Name: Default May 23 15:41:55.584956 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Id: 49f723f9ef414cd79a6167dcd852ffe1 May 23 15:41:55.584956 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1379251994-project May 23 15:41:55.584956 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: method: May 23 15:41:55.584956 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: exception: Volume 921ba662-b07e-4a98-9a81-ecb52694224a could not be found. May 23 15:41:55.584956 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: action_args: {'id': '921ba662-b07e-4a98-9a81-ecb52694224a'} May 23 15:41:55.584956 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:41:55.585936 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:41:55.585936 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 15:41:55.585936 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 15:41:55.585936 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 15:41:55.585936 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 15:41:55.585936 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 15:41:55.585936 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 15:41:55.585936 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 15:41:55.585936 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 15:41:55.585936 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 15:41:55.585936 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 15:41:55.585936 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 15:41:55.585936 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 15:41:55.585936 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 15:41:55.585936 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 15:41:55.585936 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 921ba662-b07e-4a98-9a81-ecb52694224a could not be found. (HTTP 404) (Request-ID: req-dc3e6d7e-068c-443b-8380-1b622d6592ee) May 23 15:41:55.585936 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:41:55.585936 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:41:55.585936 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:41:55.587846 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:41:55.587846 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 23 15:41:55.587846 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 23 15:41:55.587846 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 15:41:55.587846 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 15:41:55.587846 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 23 15:41:55.587846 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 23 15:41:55.587846 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 15:41:55.587846 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 15:41:55.587846 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 15:41:55.587846 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 15:41:55.587846 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 15:41:55.587846 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 15:41:55.587846 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 15:41:55.587846 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 15:41:55.587846 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 15:41:55.587846 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 15:41:55.587846 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 15:41:55.587846 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 15:41:55.588988 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 15:41:55.588988 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 15:41:55.588988 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 15:41:55.588988 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 15:41:55.588988 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 921ba662-b07e-4a98-9a81-ecb52694224a could not be found. May 23 15:41:55.588988 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:41:55.588988 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:41:55.588988 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:41:55.588988 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:41:55.588988 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:41:55.588988 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:41:55.588988 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:41:55.588988 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:41:55.588988 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 15:41:55.588988 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 15:41:55.588988 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:41:55.588988 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:41:55.588988 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 23 15:41:55.588988 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:41:55.590044 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 921ba662-b07e-4a98-9a81-ecb52694224a could not be found. May 23 15:41:55.590044 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:41:55.590044 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:41:55.590044 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:41:55.590044 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:41:55.590044 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:41:55.590044 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:41:55.590044 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:41:55.590044 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:41:55.590044 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 921ba662-b07e-4a98-9a81-ecb52694224a could not be found. May 23 15:41:55.590044 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:41:55.591887 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-6f67dfb4-8fd7-49d7-8311-8891ecf65230 tempest-VolumesSnapshotsTestJSON-1379251994 tempest-VolumesSnapshotsTestJSON-1379251994-project] Returning 404 to user: Volume 921ba662-b07e-4a98-9a81-ecb52694224a could not be found. {{(pid=124933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:41:55.593831 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-6f67dfb4-8fd7-49d7-8311-8891ecf65230 tempest-VolumesSnapshotsTestJSON-1379251994 tempest-VolumesSnapshotsTestJSON-1379251994-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/921ba662-b07e-4a98-9a81-ecb52694224a" status: 404 len: 109 microversion: 2.1 time: 1.207288 May 23 15:41:55.611343 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 31/63] 10.222.0.64 () {58 vars in 1244 bytes} [Mon May 23 15:41:54 2022] GET /compute/v2.1/os-volumes/921ba662-b07e-4a98-9a81-ecb52694224a => generated 109 bytes in 1226 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 23 15:41:55.616798 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-a7fc6c1f-53ec-49b3-8c01-a09cb06a53e9 tempest-VolumesSnapshotsTestJSON-1379251994 tempest-VolumesSnapshotsTestJSON-1379251994-project] Calling method '.version_select at 0x7fab52afb820>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:55.642622 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-f8a6c491-c5f7-4737-ac5d-7d795ecc98c8 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:41:55.657003 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-f8a6c491-c5f7-4737-ac5d-7d795ecc98c8 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 200 len: 1281 microversion: 2.1 time: 0.138953 May 23 15:41:55.657681 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 33/64] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:41:55 2022] GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 1281 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:41:55.776336 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.wsgi [None req-a7fc6c1f-53ec-49b3-8c01-a09cb06a53e9 tempest-VolumesSnapshotsTestJSON-1379251994 tempest-VolumesSnapshotsTestJSON-1379251994-project] HTTP exception thrown: Volume 921ba662-b07e-4a98-9a81-ecb52694224a could not be found. May 23 15:41:55.776336 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-a7fc6c1f-53ec-49b3-8c01-a09cb06a53e9 tempest-VolumesSnapshotsTestJSON-1379251994 tempest-VolumesSnapshotsTestJSON-1379251994-project] Request method failure captured: May 23 15:41:55.776336 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: request: DELETE /compute/v2.1/os-volumes/921ba662-b07e-4a98-9a81-ecb52694224a HTTP/1.1 May 23 15:41:55.776336 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Accept: application/json May 23 15:41:55.776336 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Accept-Encoding: identity May 23 15:41:55.776336 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Connection: close May 23 15:41:55.776336 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Content-Length: 0 May 23 15:41:55.776336 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Content-Type: application/json May 23 15:41:55.776336 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Host: 10.222.0.64 May 23 15:41:55.776336 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Openstack-System-Scope: None May 23 15:41:55.776336 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: User-Agent: python-urllib3/1.26.9 May 23 15:41:55.776336 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Auth-Token: gAAAAABii6ssbOvJA7-Tms1h7kkjjel3iEbcCefqxpGg1ZCxQ2dASD8Z61YTKGkX-eCOKKjLBwzDc2si_3dfFFoNvb1E9tMAIZ51KXV7JxY2OuP9MPqknavZoHM7xl2s9NPCoKdpdd26-J5rz4TLwVzyEUNJGM-ysZ4pGsaV4MiGI8FwkOTP604 May 23 15:41:55.776336 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Domain-Id: None May 23 15:41:55.776336 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Domain-Name: None May 23 15:41:55.776336 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Identity-Status: Confirmed May 23 15:41:55.776336 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Is-Admin-Project: True May 23 15:41:55.776336 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Domain-Id: default May 23 15:41:55.776336 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Domain-Name: Default May 23 15:41:55.776336 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Id: e3a7e6bce7fc48f996703cb5eb3533fb May 23 15:41:55.776336 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1379251994 May 23 15:41:55.776336 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Role: reader,member May 23 15:41:55.776336 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Roles: reader,member May 23 15:41:55.777519 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e3a7e6bce7fc48f996703cb5eb3533fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/e3a7e6bce7fc48f996703cb5eb3533fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e3a7e6bce7fc48f996703cb5eb3533fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_e3a7e6bce7fc48f996703cb5eb3533fb", "adminURL": "http://10.222.0.64:8080"}]}] May 23 15:41:55.777519 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1379251994 May 23 15:41:55.777519 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant-Id: e3a7e6bce7fc48f996703cb5eb3533fb May 23 15:41:55.777519 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1379251994 May 23 15:41:55.777519 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User: tempest-VolumesSnapshotsTestJSON-1379251994-project May 23 15:41:55.777519 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Domain-Id: default May 23 15:41:55.777519 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Domain-Name: Default May 23 15:41:55.777519 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Id: 49f723f9ef414cd79a6167dcd852ffe1 May 23 15:41:55.777519 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1379251994-project May 23 15:41:55.777519 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: method: May 23 15:41:55.777519 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: exception: Volume 921ba662-b07e-4a98-9a81-ecb52694224a could not be found. May 23 15:41:55.777519 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: action_args: {'id': '921ba662-b07e-4a98-9a81-ecb52694224a'} May 23 15:41:55.777519 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:41:55.778156 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:41:55.778156 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 15:41:55.778156 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 15:41:55.778156 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 23 15:41:55.778156 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 23 15:41:55.778156 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 23 15:41:55.778156 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 23 15:41:55.778156 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 23 15:41:55.778156 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 23 15:41:55.778156 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 23 15:41:55.778156 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 23 15:41:55.778156 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 15:41:55.778156 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 15:41:55.778156 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 15:41:55.778156 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 15:41:55.778156 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 921ba662-b07e-4a98-9a81-ecb52694224a could not be found. (HTTP 404) (Request-ID: req-f68309ce-9522-4112-a434-a278c5321cf2) May 23 15:41:55.778156 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:41:55.778156 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:41:55.778156 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:41:55.779167 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:41:55.779167 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 23 15:41:55.779167 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 23 15:41:55.779167 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 15:41:55.779167 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 15:41:55.779167 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 23 15:41:55.779167 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 23 15:41:55.779167 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 15:41:55.779167 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 15:41:55.779167 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 15:41:55.779167 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 15:41:55.779167 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 23 15:41:55.779167 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 23 15:41:55.779167 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 23 15:41:55.779167 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 23 15:41:55.779167 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 23 15:41:55.779167 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 23 15:41:55.779167 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 23 15:41:55.779167 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 23 15:41:55.780198 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 15:41:55.780198 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 15:41:55.780198 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 15:41:55.780198 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 15:41:55.780198 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 921ba662-b07e-4a98-9a81-ecb52694224a could not be found. May 23 15:41:55.780198 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:41:55.780198 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:41:55.780198 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:41:55.780198 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:41:55.780198 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:41:55.780198 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:41:55.780198 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:41:55.780198 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:41:55.780198 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 15:41:55.780198 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 15:41:55.780198 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:41:55.780198 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:41:55.780198 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 23 15:41:55.780198 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:41:55.782266 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 921ba662-b07e-4a98-9a81-ecb52694224a could not be found. May 23 15:41:55.782266 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:41:55.782266 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:41:55.782266 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:41:55.782266 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:41:55.782266 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:41:55.782266 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:41:55.782266 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:41:55.782266 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:41:55.782266 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 921ba662-b07e-4a98-9a81-ecb52694224a could not be found. May 23 15:41:55.782266 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:41:55.782266 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-a7fc6c1f-53ec-49b3-8c01-a09cb06a53e9 tempest-VolumesSnapshotsTestJSON-1379251994 tempest-VolumesSnapshotsTestJSON-1379251994-project] Returning 404 to user: Volume 921ba662-b07e-4a98-9a81-ecb52694224a could not be found. {{(pid=124933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:41:55.782266 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-a7fc6c1f-53ec-49b3-8c01-a09cb06a53e9 tempest-VolumesSnapshotsTestJSON-1379251994 tempest-VolumesSnapshotsTestJSON-1379251994-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/921ba662-b07e-4a98-9a81-ecb52694224a" status: 404 len: 109 microversion: 2.1 time: 0.154165 May 23 15:41:55.782266 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 32/65] 10.222.0.64 () {58 vars in 1247 bytes} [Mon May 23 15:41:55 2022] DELETE /compute/v2.1/os-volumes/921ba662-b07e-4a98-9a81-ecb52694224a => generated 109 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 23 15:41:55.785998 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-e6640b31-1d2f-44a2-ae32-5c8344f36f93 tempest-VolumesSnapshotsTestJSON-1379251994 tempest-VolumesSnapshotsTestJSON-1379251994-project] Calling method '.version_select at 0x7fab522a94c0>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:55.834579 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.wsgi [None req-e6640b31-1d2f-44a2-ae32-5c8344f36f93 tempest-VolumesSnapshotsTestJSON-1379251994 tempest-VolumesSnapshotsTestJSON-1379251994-project] HTTP exception thrown: Volume 921ba662-b07e-4a98-9a81-ecb52694224a could not be found. May 23 15:41:55.837187 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-e6640b31-1d2f-44a2-ae32-5c8344f36f93 tempest-VolumesSnapshotsTestJSON-1379251994 tempest-VolumesSnapshotsTestJSON-1379251994-project] Request method failure captured: May 23 15:41:55.837187 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: request: GET /compute/v2.1/os-volumes/921ba662-b07e-4a98-9a81-ecb52694224a HTTP/1.1 May 23 15:41:55.837187 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Accept: application/json May 23 15:41:55.837187 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Accept-Encoding: identity May 23 15:41:55.837187 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Connection: close May 23 15:41:55.837187 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Content-Length: 0 May 23 15:41:55.837187 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Content-Type: application/json May 23 15:41:55.837187 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Host: 10.222.0.64 May 23 15:41:55.837187 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Openstack-System-Scope: None May 23 15:41:55.837187 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: User-Agent: python-urllib3/1.26.9 May 23 15:41:55.837187 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Auth-Token: gAAAAABii6ssbOvJA7-Tms1h7kkjjel3iEbcCefqxpGg1ZCxQ2dASD8Z61YTKGkX-eCOKKjLBwzDc2si_3dfFFoNvb1E9tMAIZ51KXV7JxY2OuP9MPqknavZoHM7xl2s9NPCoKdpdd26-J5rz4TLwVzyEUNJGM-ysZ4pGsaV4MiGI8FwkOTP604 May 23 15:41:55.837187 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Domain-Id: None May 23 15:41:55.837187 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Domain-Name: None May 23 15:41:55.837187 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Identity-Status: Confirmed May 23 15:41:55.837187 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Is-Admin-Project: True May 23 15:41:55.837187 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Domain-Id: default May 23 15:41:55.837187 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Domain-Name: Default May 23 15:41:55.837187 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Id: e3a7e6bce7fc48f996703cb5eb3533fb May 23 15:41:55.837187 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1379251994 May 23 15:41:55.837187 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Role: reader,member May 23 15:41:55.837187 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Roles: reader,member May 23 15:41:55.838438 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e3a7e6bce7fc48f996703cb5eb3533fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/e3a7e6bce7fc48f996703cb5eb3533fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e3a7e6bce7fc48f996703cb5eb3533fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_e3a7e6bce7fc48f996703cb5eb3533fb", "adminURL": "http://10.222.0.64:8080"}]}] May 23 15:41:55.838438 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1379251994 May 23 15:41:55.838438 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant-Id: e3a7e6bce7fc48f996703cb5eb3533fb May 23 15:41:55.838438 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1379251994 May 23 15:41:55.838438 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User: tempest-VolumesSnapshotsTestJSON-1379251994-project May 23 15:41:55.838438 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Domain-Id: default May 23 15:41:55.838438 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Domain-Name: Default May 23 15:41:55.838438 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Id: 49f723f9ef414cd79a6167dcd852ffe1 May 23 15:41:55.838438 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1379251994-project May 23 15:41:55.838438 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: method: May 23 15:41:55.838438 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: exception: Volume 921ba662-b07e-4a98-9a81-ecb52694224a could not be found. May 23 15:41:55.838438 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: action_args: {'id': '921ba662-b07e-4a98-9a81-ecb52694224a'} May 23 15:41:55.838438 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:41:55.839185 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:41:55.839185 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 15:41:55.839185 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 15:41:55.839185 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 15:41:55.839185 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 15:41:55.839185 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 15:41:55.839185 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 15:41:55.839185 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 15:41:55.839185 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 15:41:55.839185 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 15:41:55.839185 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 15:41:55.839185 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 15:41:55.839185 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 15:41:55.839185 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 15:41:55.839185 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 15:41:55.839185 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 921ba662-b07e-4a98-9a81-ecb52694224a could not be found. (HTTP 404) (Request-ID: req-64768ce4-3050-4a90-9371-63b7696e0be9) May 23 15:41:55.839185 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:41:55.839185 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:41:55.839185 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:41:55.840129 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:41:55.840129 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 23 15:41:55.840129 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 23 15:41:55.840129 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 15:41:55.840129 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 15:41:55.840129 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 23 15:41:55.840129 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 23 15:41:55.840129 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 15:41:55.840129 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 15:41:55.840129 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 15:41:55.840129 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 15:41:55.840129 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 15:41:55.840129 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 15:41:55.840129 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 15:41:55.840129 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 15:41:55.840129 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 15:41:55.840129 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 15:41:55.840129 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 15:41:55.840129 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 15:41:55.841370 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 15:41:55.841370 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 15:41:55.841370 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 15:41:55.841370 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 15:41:55.841370 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 921ba662-b07e-4a98-9a81-ecb52694224a could not be found. May 23 15:41:55.841370 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:41:55.841370 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:41:55.841370 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:41:55.841370 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:41:55.841370 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:41:55.841370 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:41:55.841370 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:41:55.841370 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:41:55.841370 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 15:41:55.841370 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 15:41:55.841370 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:41:55.841370 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:41:55.841370 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 23 15:41:55.841370 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:41:55.846325 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 921ba662-b07e-4a98-9a81-ecb52694224a could not be found. May 23 15:41:55.846325 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:41:55.846325 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:41:55.846325 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:41:55.846325 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:41:55.846325 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:41:55.846325 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:41:55.846325 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:41:55.846325 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:41:55.846325 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 921ba662-b07e-4a98-9a81-ecb52694224a could not be found. May 23 15:41:55.846325 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:41:55.846325 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-e6640b31-1d2f-44a2-ae32-5c8344f36f93 tempest-VolumesSnapshotsTestJSON-1379251994 tempest-VolumesSnapshotsTestJSON-1379251994-project] Returning 404 to user: Volume 921ba662-b07e-4a98-9a81-ecb52694224a could not be found. {{(pid=124934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:41:55.846325 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-e6640b31-1d2f-44a2-ae32-5c8344f36f93 tempest-VolumesSnapshotsTestJSON-1379251994 tempest-VolumesSnapshotsTestJSON-1379251994-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/921ba662-b07e-4a98-9a81-ecb52694224a" status: 404 len: 109 microversion: 2.1 time: 0.061378 May 23 15:41:55.846325 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 34/66] 10.222.0.64 () {58 vars in 1244 bytes} [Mon May 23 15:41:55 2022] GET /compute/v2.1/os-volumes/921ba662-b07e-4a98-9a81-ecb52694224a => generated 109 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 15:41:56.267451 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-76d26ae4-0e0b-4b4c-a230-78375d68ea73 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:56.268135 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-76d26ae4-0e0b-4b4c-a230-78375d68ea73 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] [instance: e30f4234-a3e5-4cf3-8d65-583de8fbca41] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:41:56.274391 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-76d26ae4-0e0b-4b4c-a230-78375d68ea73 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:56.274836 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-76d26ae4-0e0b-4b4c-a230-78375d68ea73 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:56.275635 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-76d26ae4-0e0b-4b4c-a230-78375d68ea73 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:56.276072 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-76d26ae4-0e0b-4b4c-a230-78375d68ea73 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:56.375410 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-3a647781-800b-4ac5-b189-5d81c2a88692 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:56.376017 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-3a647781-800b-4ac5-b189-5d81c2a88692 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:41:56.386771 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3a647781-800b-4ac5-b189-5d81c2a88692 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:56.387196 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3a647781-800b-4ac5-b189-5d81c2a88692 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:56.387991 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3a647781-800b-4ac5-b189-5d81c2a88692 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:56.388444 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3a647781-800b-4ac5-b189-5d81c2a88692 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:56.502929 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-3a647781-800b-4ac5-b189-5d81c2a88692 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:41:56.507479 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-76d26ae4-0e0b-4b4c-a230-78375d68ea73 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916c7e4c45a94167ba39db8c7fec0d19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a819820263647f784079581c7527921', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:41:56.517284 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-3a647781-800b-4ac5-b189-5d81c2a88692 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 200 len: 1232 microversion: 2.1 time: 0.144839 May 23 15:41:56.517284 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 35/67] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:41:56 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 1232 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:41:56.522491 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-76d26ae4-0e0b-4b4c-a230-78375d68ea73 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] 10.222.0.64 "GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41" status: 200 len: 1314 microversion: 2.1 time: 0.259572 May 23 15:41:56.523498 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 33/68] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:41:56 2022] GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41 => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:41:56.680475 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-ec792c5d-5870-4ac8-ab5e-e52c4c188bb2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:56.681748 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-ec792c5d-5870-4ac8-ab5e-e52c4c188bb2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:41:56.688609 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ec792c5d-5870-4ac8-ab5e-e52c4c188bb2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:56.689090 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ec792c5d-5870-4ac8-ab5e-e52c4c188bb2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:56.690393 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ec792c5d-5870-4ac8-ab5e-e52c4c188bb2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:56.691475 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ec792c5d-5870-4ac8-ab5e-e52c4c188bb2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:56.786416 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-ec792c5d-5870-4ac8-ab5e-e52c4c188bb2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:41:56.795012 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-ec792c5d-5870-4ac8-ab5e-e52c4c188bb2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 200 len: 1281 microversion: 2.1 time: 0.118235 May 23 15:41:56.795842 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 36/69] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:41:56 2022] GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 1281 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:41:57.533167 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-0e02bc6e-d6ce-4646-afd9-24591bd8ad1e tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:57.533757 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-0e02bc6e-d6ce-4646-afd9-24591bd8ad1e tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:41:57.540015 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-0e02bc6e-d6ce-4646-afd9-24591bd8ad1e tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:57.540173 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-74d3712b-96f5-4101-9de8-8ab80b537ce6 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:57.540618 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-0e02bc6e-d6ce-4646-afd9-24591bd8ad1e tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:57.540790 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-74d3712b-96f5-4101-9de8-8ab80b537ce6 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] [instance: e30f4234-a3e5-4cf3-8d65-583de8fbca41] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:41:57.541242 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-0e02bc6e-d6ce-4646-afd9-24591bd8ad1e tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:57.541675 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-0e02bc6e-d6ce-4646-afd9-24591bd8ad1e tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:57.549227 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-74d3712b-96f5-4101-9de8-8ab80b537ce6 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:57.549698 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-74d3712b-96f5-4101-9de8-8ab80b537ce6 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:57.550481 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-74d3712b-96f5-4101-9de8-8ab80b537ce6 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:57.550919 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-74d3712b-96f5-4101-9de8-8ab80b537ce6 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:57.663150 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-0e02bc6e-d6ce-4646-afd9-24591bd8ad1e tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:41:57.671576 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-0e02bc6e-d6ce-4646-afd9-24591bd8ad1e tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 200 len: 1232 microversion: 2.1 time: 0.142767 May 23 15:41:57.672664 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 34/70] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:41:57 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 1232 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:41:57.812207 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-29dac421-f33b-422f-b7e4-d1a1cb8d31c1 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:57.812910 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-29dac421-f33b-422f-b7e4-d1a1cb8d31c1 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:41:57.824916 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-29dac421-f33b-422f-b7e4-d1a1cb8d31c1 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:57.827662 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-29dac421-f33b-422f-b7e4-d1a1cb8d31c1 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:57.829274 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-29dac421-f33b-422f-b7e4-d1a1cb8d31c1 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:57.829728 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-29dac421-f33b-422f-b7e4-d1a1cb8d31c1 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:57.860590 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-74d3712b-96f5-4101-9de8-8ab80b537ce6 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916c7e4c45a94167ba39db8c7fec0d19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a819820263647f784079581c7527921', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:41:57.868203 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-74d3712b-96f5-4101-9de8-8ab80b537ce6 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] 10.222.0.64 "GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41" status: 200 len: 1314 microversion: 2.1 time: 0.331759 May 23 15:41:57.869203 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 37/71] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:41:57 2022] GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41 => generated 1314 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:41:57.917100 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-29dac421-f33b-422f-b7e4-d1a1cb8d31c1 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:41:57.926808 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-29dac421-f33b-422f-b7e4-d1a1cb8d31c1 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 200 len: 1281 microversion: 2.1 time: 0.118903 May 23 15:41:57.927676 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 35/72] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:41:57 2022] GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 1281 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:41:58.688371 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-f80b0db7-1d90-4fee-be69-71604ca997df tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:58.689150 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-f80b0db7-1d90-4fee-be69-71604ca997df tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:41:58.701871 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-f80b0db7-1d90-4fee-be69-71604ca997df tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:58.710551 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-f80b0db7-1d90-4fee-be69-71604ca997df tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:58.711512 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-f80b0db7-1d90-4fee-be69-71604ca997df tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:58.712007 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-f80b0db7-1d90-4fee-be69-71604ca997df tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:58.817006 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-f80b0db7-1d90-4fee-be69-71604ca997df tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:41:58.817006 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-f80b0db7-1d90-4fee-be69-71604ca997df tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 200 len: 1232 microversion: 2.1 time: 0.122586 May 23 15:41:58.837248 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 38/73] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:41:58 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 1232 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:41:58.889281 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-b7b82b5d-88f2-44c6-a421-e8f6f2c67f0d tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:58.890755 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-b7b82b5d-88f2-44c6-a421-e8f6f2c67f0d tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] [instance: e30f4234-a3e5-4cf3-8d65-583de8fbca41] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:41:58.892821 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_cell0:SELECT=4 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:41:58.909436 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b7b82b5d-88f2-44c6-a421-e8f6f2c67f0d tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:58.909940 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b7b82b5d-88f2-44c6-a421-e8f6f2c67f0d tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:58.910796 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b7b82b5d-88f2-44c6-a421-e8f6f2c67f0d tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:58.911280 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b7b82b5d-88f2-44c6-a421-e8f6f2c67f0d tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:58.944679 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-8fdb37f1-a320-4fea-9d4e-92a5fc1e64a0 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:58.945266 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-8fdb37f1-a320-4fea-9d4e-92a5fc1e64a0 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:41:58.951294 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-8fdb37f1-a320-4fea-9d4e-92a5fc1e64a0 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:58.952081 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-8fdb37f1-a320-4fea-9d4e-92a5fc1e64a0 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:58.952553 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-8fdb37f1-a320-4fea-9d4e-92a5fc1e64a0 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:58.953002 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-8fdb37f1-a320-4fea-9d4e-92a5fc1e64a0 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:59.060505 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-8fdb37f1-a320-4fea-9d4e-92a5fc1e64a0 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:41:59.069933 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-8fdb37f1-a320-4fea-9d4e-92a5fc1e64a0 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 200 len: 1281 microversion: 2.1 time: 0.129168 May 23 15:41:59.081107 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 39/74] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:41:58 2022] GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 1281 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:41:59.140362 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-b7b82b5d-88f2-44c6-a421-e8f6f2c67f0d tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916c7e4c45a94167ba39db8c7fec0d19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a819820263647f784079581c7527921', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:41:59.148044 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-b7b82b5d-88f2-44c6-a421-e8f6f2c67f0d tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] 10.222.0.64 "GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41" status: 200 len: 1314 microversion: 2.1 time: 0.263779 May 23 15:41:59.160254 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 36/75] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:41:58 2022] GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41 => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:41:59.839701 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-fb8fce89-27a4-45a8-a861-8de8978ad277 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:41:59.839701 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-fb8fce89-27a4-45a8-a861-8de8978ad277 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:41:59.859428 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-fb8fce89-27a4-45a8-a861-8de8978ad277 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:59.860055 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-fb8fce89-27a4-45a8-a861-8de8978ad277 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:59.863538 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-fb8fce89-27a4-45a8-a861-8de8978ad277 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:41:59.864101 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-fb8fce89-27a4-45a8-a861-8de8978ad277 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:41:59.953397 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-fb8fce89-27a4-45a8-a861-8de8978ad277 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:41:59.961869 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-fb8fce89-27a4-45a8-a861-8de8978ad277 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 200 len: 1232 microversion: 2.1 time: 0.129318 May 23 15:41:59.964882 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 40/76] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:41:59 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 1232 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:00.088647 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-b1e2e99f-6aea-4219-8dc2-e2fc472e08e6 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:00.090127 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-b1e2e99f-6aea-4219-8dc2-e2fc472e08e6 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:00.100863 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b1e2e99f-6aea-4219-8dc2-e2fc472e08e6 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:00.101586 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b1e2e99f-6aea-4219-8dc2-e2fc472e08e6 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:00.102581 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b1e2e99f-6aea-4219-8dc2-e2fc472e08e6 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:00.103208 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b1e2e99f-6aea-4219-8dc2-e2fc472e08e6 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:00.166112 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-5d8b80ae-58d6-4b57-906c-c19c4bec106d tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:00.166892 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-5d8b80ae-58d6-4b57-906c-c19c4bec106d tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] [instance: e30f4234-a3e5-4cf3-8d65-583de8fbca41] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:00.175854 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5d8b80ae-58d6-4b57-906c-c19c4bec106d tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:00.176311 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5d8b80ae-58d6-4b57-906c-c19c4bec106d tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:00.181002 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5d8b80ae-58d6-4b57-906c-c19c4bec106d tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:00.181692 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5d8b80ae-58d6-4b57-906c-c19c4bec106d tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:00.200848 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_cell1:SELECT=100 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:42:00.309517 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-b1e2e99f-6aea-4219-8dc2-e2fc472e08e6 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:00.317511 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-b1e2e99f-6aea-4219-8dc2-e2fc472e08e6 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 200 len: 1281 microversion: 2.1 time: 0.233775 May 23 15:42:00.320802 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 37/77] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:00 2022] GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 1281 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:00.564130 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-5d8b80ae-58d6-4b57-906c-c19c4bec106d tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916c7e4c45a94167ba39db8c7fec0d19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a819820263647f784079581c7527921', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:00.571901 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-5d8b80ae-58d6-4b57-906c-c19c4bec106d tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] 10.222.0.64 "GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41" status: 200 len: 1314 microversion: 2.1 time: 0.409763 May 23 15:42:00.575630 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 41/78] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:00 2022] GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41 => generated 1314 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:42:00.984169 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-368cedd9-4d1d-42fe-a6a9-493f5106b4ce tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:00.985262 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-368cedd9-4d1d-42fe-a6a9-493f5106b4ce tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:00.997211 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-368cedd9-4d1d-42fe-a6a9-493f5106b4ce tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:00.999176 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-368cedd9-4d1d-42fe-a6a9-493f5106b4ce tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:01.000020 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-368cedd9-4d1d-42fe-a6a9-493f5106b4ce tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:01.000469 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-368cedd9-4d1d-42fe-a6a9-493f5106b4ce tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:01.198355 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-368cedd9-4d1d-42fe-a6a9-493f5106b4ce tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:01.220777 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-368cedd9-4d1d-42fe-a6a9-493f5106b4ce tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 200 len: 1232 microversion: 2.1 time: 0.228700 May 23 15:42:01.223041 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 38/79] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:00 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 1232 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:01.336715 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-bab5a576-3275-4d09-b323-670ec9fc6c87 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:01.338219 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-bab5a576-3275-4d09-b323-670ec9fc6c87 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:01.356553 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-bab5a576-3275-4d09-b323-670ec9fc6c87 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:01.358745 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-bab5a576-3275-4d09-b323-670ec9fc6c87 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:01.361463 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-bab5a576-3275-4d09-b323-670ec9fc6c87 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:01.363661 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-bab5a576-3275-4d09-b323-670ec9fc6c87 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:01.474184 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-bab5a576-3275-4d09-b323-670ec9fc6c87 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:01.485477 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-bab5a576-3275-4d09-b323-670ec9fc6c87 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 200 len: 1281 microversion: 2.1 time: 0.149928 May 23 15:42:01.485477 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 42/80] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:01 2022] GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 1281 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:01.595885 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-4dafd375-f265-419e-8553-0ca6bdb1c707 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:01.596852 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-4dafd375-f265-419e-8553-0ca6bdb1c707 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] [instance: e30f4234-a3e5-4cf3-8d65-583de8fbca41] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:01.604553 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-4dafd375-f265-419e-8553-0ca6bdb1c707 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:01.609366 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-4dafd375-f265-419e-8553-0ca6bdb1c707 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:01.609366 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-4dafd375-f265-419e-8553-0ca6bdb1c707 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:01.609366 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-4dafd375-f265-419e-8553-0ca6bdb1c707 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:01.707376 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_cell1:SELECT=100 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:42:01.912801 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-4dafd375-f265-419e-8553-0ca6bdb1c707 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916c7e4c45a94167ba39db8c7fec0d19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a819820263647f784079581c7527921', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:01.927450 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-4dafd375-f265-419e-8553-0ca6bdb1c707 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] 10.222.0.64 "GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41" status: 200 len: 1314 microversion: 2.1 time: 0.336509 May 23 15:42:01.946944 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 39/81] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:01 2022] GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41 => generated 1314 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:42:02.242828 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-84a3f647-b535-4339-a0f0-342937e046d2 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:02.244286 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-84a3f647-b535-4339-a0f0-342937e046d2 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:02.254076 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_cell0:SELECT=2 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:42:02.255291 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_cell0:SELECT=18 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:42:02.259244 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-84a3f647-b535-4339-a0f0-342937e046d2 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:02.260069 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-84a3f647-b535-4339-a0f0-342937e046d2 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:02.261400 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-84a3f647-b535-4339-a0f0-342937e046d2 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:02.262237 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-84a3f647-b535-4339-a0f0-342937e046d2 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:02.350855 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-84a3f647-b535-4339-a0f0-342937e046d2 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:02.363740 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-84a3f647-b535-4339-a0f0-342937e046d2 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 200 len: 1288 microversion: 2.1 time: 0.127135 May 23 15:42:02.374971 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 43/82] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:02 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 1288 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:02.500983 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-617fefe9-77e0-4cf3-878c-e208c108f609 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:02.501789 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-617fefe9-77e0-4cf3-878c-e208c108f609 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:02.503756 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=9 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:42:02.508568 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-617fefe9-77e0-4cf3-878c-e208c108f609 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:02.509126 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-617fefe9-77e0-4cf3-878c-e208c108f609 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:02.510130 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-617fefe9-77e0-4cf3-878c-e208c108f609 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:02.510724 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-617fefe9-77e0-4cf3-878c-e208c108f609 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:02.578829 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-617fefe9-77e0-4cf3-878c-e208c108f609 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:02.586136 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-617fefe9-77e0-4cf3-878c-e208c108f609 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 200 len: 1291 microversion: 2.1 time: 0.089738 May 23 15:42:02.586693 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 40/83] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:02 2022] GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 1291 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:02.947569 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-accf61c1-c377-4240-a94e-59c83165274e tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:02.948253 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-accf61c1-c377-4240-a94e-59c83165274e tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] [instance: e30f4234-a3e5-4cf3-8d65-583de8fbca41] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:02.957712 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=4 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:42:02.968602 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-accf61c1-c377-4240-a94e-59c83165274e tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:02.969504 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-accf61c1-c377-4240-a94e-59c83165274e tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:02.970827 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-accf61c1-c377-4240-a94e-59c83165274e tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:02.971451 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-accf61c1-c377-4240-a94e-59c83165274e tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:03.257954 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-accf61c1-c377-4240-a94e-59c83165274e tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916c7e4c45a94167ba39db8c7fec0d19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a819820263647f784079581c7527921', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:03.267036 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-accf61c1-c377-4240-a94e-59c83165274e tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] 10.222.0.64 "GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41" status: 200 len: 1314 microversion: 2.1 time: 0.324453 May 23 15:42:03.267813 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 44/84] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:02 2022] GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41 => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:03.382687 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-159d451d-7fbe-4fe0-94c6-2cbd258ef911 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:03.384062 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-159d451d-7fbe-4fe0-94c6-2cbd258ef911 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:03.387240 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_cell0:SELECT=26 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:42:03.393531 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-159d451d-7fbe-4fe0-94c6-2cbd258ef911 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:03.393985 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-159d451d-7fbe-4fe0-94c6-2cbd258ef911 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:03.394760 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-159d451d-7fbe-4fe0-94c6-2cbd258ef911 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:03.395197 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-159d451d-7fbe-4fe0-94c6-2cbd258ef911 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:03.484886 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-159d451d-7fbe-4fe0-94c6-2cbd258ef911 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:03.494199 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-159d451d-7fbe-4fe0-94c6-2cbd258ef911 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 200 len: 1296 microversion: 2.1 time: 0.115925 May 23 15:42:03.495074 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 41/85] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:03 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 1296 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:03.603568 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-eb622305-d158-40fc-a764-69db2c64b4ee tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:03.604161 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-eb622305-d158-40fc-a764-69db2c64b4ee tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:03.611936 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-eb622305-d158-40fc-a764-69db2c64b4ee tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:03.612650 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-eb622305-d158-40fc-a764-69db2c64b4ee tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:03.613687 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-eb622305-d158-40fc-a764-69db2c64b4ee tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:03.614316 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-eb622305-d158-40fc-a764-69db2c64b4ee tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:03.730590 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-eb622305-d158-40fc-a764-69db2c64b4ee tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:03.741392 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-eb622305-d158-40fc-a764-69db2c64b4ee tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 200 len: 1279 microversion: 2.1 time: 0.141722 May 23 15:42:03.742429 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 45/86] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:03 2022] GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 1279 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:04.284618 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-0ba2be6e-b867-4065-9d0c-34956d31d5e5 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:04.285416 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-0ba2be6e-b867-4065-9d0c-34956d31d5e5 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] [instance: e30f4234-a3e5-4cf3-8d65-583de8fbca41] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:04.296452 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-0ba2be6e-b867-4065-9d0c-34956d31d5e5 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:04.301992 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-0ba2be6e-b867-4065-9d0c-34956d31d5e5 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:04.301992 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-0ba2be6e-b867-4065-9d0c-34956d31d5e5 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:04.301992 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-0ba2be6e-b867-4065-9d0c-34956d31d5e5 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:04.511888 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-4fd3cc48-5ed7-4a66-873f-e1fff2fe6b68 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:04.512594 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-4fd3cc48-5ed7-4a66-873f-e1fff2fe6b68 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:04.521020 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4fd3cc48-5ed7-4a66-873f-e1fff2fe6b68 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:04.521960 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4fd3cc48-5ed7-4a66-873f-e1fff2fe6b68 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:04.523156 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4fd3cc48-5ed7-4a66-873f-e1fff2fe6b68 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:04.524087 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4fd3cc48-5ed7-4a66-873f-e1fff2fe6b68 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:04.658106 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-0ba2be6e-b867-4065-9d0c-34956d31d5e5 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916c7e4c45a94167ba39db8c7fec0d19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a819820263647f784079581c7527921', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:04.667038 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-0ba2be6e-b867-4065-9d0c-34956d31d5e5 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] 10.222.0.64 "GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41" status: 200 len: 1314 microversion: 2.1 time: 0.385872 May 23 15:42:04.677973 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-4fd3cc48-5ed7-4a66-873f-e1fff2fe6b68 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:04.678536 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 42/87] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:04 2022] GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41 => generated 1314 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:04.686741 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-4fd3cc48-5ed7-4a66-873f-e1fff2fe6b68 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 200 len: 1296 microversion: 2.1 time: 0.177558 May 23 15:42:04.687259 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 46/88] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:04 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 1296 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:42:04.761095 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-ec83084b-a68c-4073-9561-29aaaba6d882 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:04.761893 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-ec83084b-a68c-4073-9561-29aaaba6d882 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:04.768744 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ec83084b-a68c-4073-9561-29aaaba6d882 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:04.769506 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ec83084b-a68c-4073-9561-29aaaba6d882 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:04.770870 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ec83084b-a68c-4073-9561-29aaaba6d882 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:04.771509 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ec83084b-a68c-4073-9561-29aaaba6d882 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:05.002643 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-ec83084b-a68c-4073-9561-29aaaba6d882 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:05.010323 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-ec83084b-a68c-4073-9561-29aaaba6d882 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 200 len: 1321 microversion: 2.1 time: 0.254361 May 23 15:42:05.010888 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 43/89] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:04 2022] GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 1321 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:05.492748 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [req-b4ab7e32-f423-4872-8050-73d6cd82c779 req-2ae188e1-fd6a-4f80-a28a-02215f7a5253 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e30f4234-a3e5-4cf3-8d65-583de8fbca41", "tag": "620fab52-b890-4499-b5f7-e33158b7c317"}]} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:42:05.507500 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-b4ab7e32-f423-4872-8050-73d6cd82c779 req-2ae188e1-fd6a-4f80-a28a-02215f7a5253 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:05.507500 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-b4ab7e32-f423-4872-8050-73d6cd82c779 req-2ae188e1-fd6a-4f80-a28a-02215f7a5253 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:05.525356 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.compute.server_external_events [req-b4ab7e32-f423-4872-8050-73d6cd82c779 req-2ae188e1-fd6a-4f80-a28a-02215f7a5253 service nova] Creating event network-changed:620fab52-b890-4499-b5f7-e33158b7c317 for instance e30f4234-a3e5-4cf3-8d65-583de8fbca41 on hv-cinder-84067 May 23 15:42:05.525923 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-b4ab7e32-f423-4872-8050-73d6cd82c779 req-2ae188e1-fd6a-4f80-a28a-02215f7a5253 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124934) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 23 15:42:05.527051 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4cb80ef2-50f1-4a29-8b8e-2cc2b5306176 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:05.527497 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4cb80ef2-50f1-4a29-8b8e-2cc2b5306176 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:05.528289 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4cb80ef2-50f1-4a29-8b8e-2cc2b5306176 None None] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:05.528725 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4cb80ef2-50f1-4a29-8b8e-2cc2b5306176 None None] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:05.538134 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.compute.rpcapi [None req-4cb80ef2-50f1-4a29-8b8e-2cc2b5306176 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 23 15:42:05.539022 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4cb80ef2-50f1-4a29-8b8e-2cc2b5306176 None None] Releasing lock "compute-rpcapi-router" {{(pid=124934) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 23 15:42:05.554799 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-4cb80ef2-50f1-4a29-8b8e-2cc2b5306176 None None] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146307 May 23 15:42:05.555747 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 47/90] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:42:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:42:05.689128 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-7b6746d4-9cd7-4bb1-b6fa-bf1c34cae83a tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:05.689128 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-7b6746d4-9cd7-4bb1-b6fa-bf1c34cae83a tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] [instance: e30f4234-a3e5-4cf3-8d65-583de8fbca41] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:05.693024 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-7b6746d4-9cd7-4bb1-b6fa-bf1c34cae83a tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:05.693526 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-7b6746d4-9cd7-4bb1-b6fa-bf1c34cae83a tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:05.694300 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-7b6746d4-9cd7-4bb1-b6fa-bf1c34cae83a tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:05.694743 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-7b6746d4-9cd7-4bb1-b6fa-bf1c34cae83a tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:05.704529 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-785e90ae-210b-4b46-9f94-76fd49546a14 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:05.705438 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-785e90ae-210b-4b46-9f94-76fd49546a14 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:05.711687 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-785e90ae-210b-4b46-9f94-76fd49546a14 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:05.712218 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-785e90ae-210b-4b46-9f94-76fd49546a14 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:05.713087 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-785e90ae-210b-4b46-9f94-76fd49546a14 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:05.713766 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-785e90ae-210b-4b46-9f94-76fd49546a14 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:05.798616 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-785e90ae-210b-4b46-9f94-76fd49546a14 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:05.806809 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-785e90ae-210b-4b46-9f94-76fd49546a14 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 200 len: 1296 microversion: 2.1 time: 0.106650 May 23 15:42:05.807887 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 48/91] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:05 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 1296 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:42:05.860927 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-7b6746d4-9cd7-4bb1-b6fa-bf1c34cae83a tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916c7e4c45a94167ba39db8c7fec0d19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a819820263647f784079581c7527921', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:05.868340 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-7b6746d4-9cd7-4bb1-b6fa-bf1c34cae83a tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] 10.222.0.64 "GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41" status: 200 len: 1314 microversion: 2.1 time: 0.186739 May 23 15:42:05.869268 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 44/92] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:05 2022] GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:06.026646 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-3c92c136-df83-4bd1-b896-595526ae6894 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:06.027262 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-3c92c136-df83-4bd1-b896-595526ae6894 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:06.033330 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3c92c136-df83-4bd1-b896-595526ae6894 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:06.033778 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3c92c136-df83-4bd1-b896-595526ae6894 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:06.034537 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3c92c136-df83-4bd1-b896-595526ae6894 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:06.040009 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3c92c136-df83-4bd1-b896-595526ae6894 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:06.199068 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-3c92c136-df83-4bd1-b896-595526ae6894 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:06.208603 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-3c92c136-df83-4bd1-b896-595526ae6894 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 200 len: 1321 microversion: 2.1 time: 0.185669 May 23 15:42:06.209532 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 49/93] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:06 2022] GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 1321 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:06.832642 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-875da9fb-00b1-4fe3-869d-55d8dde6d55a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:06.834992 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-875da9fb-00b1-4fe3-869d-55d8dde6d55a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:06.857300 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-875da9fb-00b1-4fe3-869d-55d8dde6d55a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:06.859188 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-875da9fb-00b1-4fe3-869d-55d8dde6d55a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:06.860950 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-875da9fb-00b1-4fe3-869d-55d8dde6d55a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:06.861613 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-875da9fb-00b1-4fe3-869d-55d8dde6d55a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:06.886754 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-99c49136-f704-4f6d-9bd7-c0a04ceeda90 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:06.887386 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-99c49136-f704-4f6d-9bd7-c0a04ceeda90 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] [instance: e30f4234-a3e5-4cf3-8d65-583de8fbca41] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:06.904061 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-99c49136-f704-4f6d-9bd7-c0a04ceeda90 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:06.907317 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-99c49136-f704-4f6d-9bd7-c0a04ceeda90 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:06.912439 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-99c49136-f704-4f6d-9bd7-c0a04ceeda90 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:06.912912 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-99c49136-f704-4f6d-9bd7-c0a04ceeda90 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:07.366812 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-875da9fb-00b1-4fe3-869d-55d8dde6d55a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:07.380613 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-875da9fb-00b1-4fe3-869d-55d8dde6d55a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 200 len: 1306 microversion: 2.1 time: 0.560417 May 23 15:42:07.385333 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 45/94] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:06 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 1306 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:07.403140 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-3858ec62-6a48-4f42-9726-1efb4a12fa95 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:07.404170 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-3858ec62-6a48-4f42-9726-1efb4a12fa95 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:07.420340 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-3858ec62-6a48-4f42-9726-1efb4a12fa95 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:07.421003 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-3858ec62-6a48-4f42-9726-1efb4a12fa95 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:07.422236 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-3858ec62-6a48-4f42-9726-1efb4a12fa95 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:07.423494 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-3858ec62-6a48-4f42-9726-1efb4a12fa95 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:07.945134 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-99c49136-f704-4f6d-9bd7-c0a04ceeda90 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916c7e4c45a94167ba39db8c7fec0d19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a819820263647f784079581c7527921', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:07.955012 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-99c49136-f704-4f6d-9bd7-c0a04ceeda90 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] 10.222.0.64 "GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41" status: 200 len: 1314 microversion: 2.1 time: 1.073046 May 23 15:42:07.956462 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 50/95] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:06 2022] GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41 => generated 1314 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:42:07.962787 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [req-46b483b7-9a59-4258-89f9-71cf7cf08d8a req-89a221e8-8cdb-4e76-8435-fbde0b46af65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbe72f52-c8f9-46ea-ae59-9d2fe0a49523", "tag": "d9ed8cc1-0b96-4f2b-a6a8-4413cb65225f"}]} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:42:07.977864 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-46b483b7-9a59-4258-89f9-71cf7cf08d8a req-89a221e8-8cdb-4e76-8435-fbde0b46af65 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:07.978235 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-46b483b7-9a59-4258-89f9-71cf7cf08d8a req-89a221e8-8cdb-4e76-8435-fbde0b46af65 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:07.994728 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.compute.server_external_events [req-46b483b7-9a59-4258-89f9-71cf7cf08d8a req-89a221e8-8cdb-4e76-8435-fbde0b46af65 service nova] Creating event network-changed:d9ed8cc1-0b96-4f2b-a6a8-4413cb65225f for instance bbe72f52-c8f9-46ea-ae59-9d2fe0a49523 on hv-cinder-84067 May 23 15:42:08.006486 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [req-46b483b7-9a59-4258-89f9-71cf7cf08d8a req-89a221e8-8cdb-4e76-8435-fbde0b46af65 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048139 May 23 15:42:08.007499 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 51/96] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:42:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:42:08.191179 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-3858ec62-6a48-4f42-9726-1efb4a12fa95 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:08.199432 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-3858ec62-6a48-4f42-9726-1efb4a12fa95 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 200 len: 1321 microversion: 2.1 time: 0.812793 May 23 15:42:08.200326 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 46/97] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:07 2022] GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 1321 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:08.301393 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [req-74d91386-d286-4947-808f-fa917c857cb2 req-826a6c26-2efb-4111-baa5-1c969b5332a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1210ee26-89ef-4f9e-b0e9-9534c3dd9d09", "tag": "e89cca66-d50b-4f6c-a342-f64ba7767359"}]} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:42:08.323753 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-74d91386-d286-4947-808f-fa917c857cb2 req-826a6c26-2efb-4111-baa5-1c969b5332a5 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:08.330914 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-74d91386-d286-4947-808f-fa917c857cb2 req-826a6c26-2efb-4111-baa5-1c969b5332a5 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:08.353878 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.compute.server_external_events [req-74d91386-d286-4947-808f-fa917c857cb2 req-826a6c26-2efb-4111-baa5-1c969b5332a5 service nova] Creating event network-changed:e89cca66-d50b-4f6c-a342-f64ba7767359 for instance 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 on hv-cinder-84067 May 23 15:42:08.361778 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [req-74d91386-d286-4947-808f-fa917c857cb2 req-826a6c26-2efb-4111-baa5-1c969b5332a5 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.181984 May 23 15:42:08.364004 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 52/98] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:42:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:42:08.400210 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-6e85db7e-24e5-4c2e-8a75-0b0befe347d6 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:08.400823 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-6e85db7e-24e5-4c2e-8a75-0b0befe347d6 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:08.407887 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-6e85db7e-24e5-4c2e-8a75-0b0befe347d6 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:08.408346 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-6e85db7e-24e5-4c2e-8a75-0b0befe347d6 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:08.409133 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-6e85db7e-24e5-4c2e-8a75-0b0befe347d6 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:08.409567 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-6e85db7e-24e5-4c2e-8a75-0b0befe347d6 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:08.525446 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-6e85db7e-24e5-4c2e-8a75-0b0befe347d6 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:08.535821 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-6e85db7e-24e5-4c2e-8a75-0b0befe347d6 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 200 len: 1294 microversion: 2.1 time: 0.139131 May 23 15:42:08.550713 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 47/99] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:08 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 1294 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:08.972626 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-884d1ecd-7445-4740-a5c7-d3bde4fba359 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:08.973438 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-884d1ecd-7445-4740-a5c7-d3bde4fba359 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] [instance: e30f4234-a3e5-4cf3-8d65-583de8fbca41] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:08.981344 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-884d1ecd-7445-4740-a5c7-d3bde4fba359 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:08.981892 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-884d1ecd-7445-4740-a5c7-d3bde4fba359 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:08.982894 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-884d1ecd-7445-4740-a5c7-d3bde4fba359 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:08.983414 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-884d1ecd-7445-4740-a5c7-d3bde4fba359 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:09.137861 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-884d1ecd-7445-4740-a5c7-d3bde4fba359 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916c7e4c45a94167ba39db8c7fec0d19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a819820263647f784079581c7527921', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:09.146228 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-884d1ecd-7445-4740-a5c7-d3bde4fba359 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] 10.222.0.64 "GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41" status: 200 len: 1314 microversion: 2.1 time: 0.177907 May 23 15:42:09.146943 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 53/100] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:08 2022] GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:09.216155 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-55e49f34-229f-4a82-8fe5-45e4b2c19656 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:09.217404 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-55e49f34-229f-4a82-8fe5-45e4b2c19656 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:09.224693 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-55e49f34-229f-4a82-8fe5-45e4b2c19656 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:09.225300 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-55e49f34-229f-4a82-8fe5-45e4b2c19656 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:09.226183 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-55e49f34-229f-4a82-8fe5-45e4b2c19656 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:09.226996 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-55e49f34-229f-4a82-8fe5-45e4b2c19656 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:09.363863 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-55e49f34-229f-4a82-8fe5-45e4b2c19656 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:09.371189 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-55e49f34-229f-4a82-8fe5-45e4b2c19656 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 200 len: 1321 microversion: 2.1 time: 0.158877 May 23 15:42:09.371741 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 48/101] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:09 2022] GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:09.554693 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-0d19cb85-6142-47fc-9fdc-6a3809bd893a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:09.555307 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-0d19cb85-6142-47fc-9fdc-6a3809bd893a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:09.562080 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0d19cb85-6142-47fc-9fdc-6a3809bd893a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:09.562542 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0d19cb85-6142-47fc-9fdc-6a3809bd893a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:09.563312 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0d19cb85-6142-47fc-9fdc-6a3809bd893a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:09.563749 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0d19cb85-6142-47fc-9fdc-6a3809bd893a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:09.716836 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-0d19cb85-6142-47fc-9fdc-6a3809bd893a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:09.718947 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-0d19cb85-6142-47fc-9fdc-6a3809bd893a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 200 len: 1362 microversion: 2.1 time: 0.168051 May 23 15:42:09.723369 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 54/102] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:09 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:10.163256 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-52ae36b8-4407-4d54-af4f-7315654b0210 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:10.163929 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-52ae36b8-4407-4d54-af4f-7315654b0210 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] [instance: e30f4234-a3e5-4cf3-8d65-583de8fbca41] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:10.171935 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-52ae36b8-4407-4d54-af4f-7315654b0210 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:10.172396 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-52ae36b8-4407-4d54-af4f-7315654b0210 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:10.173207 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-52ae36b8-4407-4d54-af4f-7315654b0210 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:10.173645 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-52ae36b8-4407-4d54-af4f-7315654b0210 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:10.360233 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-52ae36b8-4407-4d54-af4f-7315654b0210 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916c7e4c45a94167ba39db8c7fec0d19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a819820263647f784079581c7527921', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:10.374094 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-52ae36b8-4407-4d54-af4f-7315654b0210 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] 10.222.0.64 "GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41" status: 200 len: 1314 microversion: 2.1 time: 0.214216 May 23 15:42:10.374666 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 49/103] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:10 2022] GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:10.387541 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-35b4e4c7-4880-44f8-9c1c-71933f2e9715 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:10.399757 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-35b4e4c7-4880-44f8-9c1c-71933f2e9715 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:10.399757 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-35b4e4c7-4880-44f8-9c1c-71933f2e9715 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:10.399757 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-35b4e4c7-4880-44f8-9c1c-71933f2e9715 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:10.399757 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-35b4e4c7-4880-44f8-9c1c-71933f2e9715 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:10.400264 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-35b4e4c7-4880-44f8-9c1c-71933f2e9715 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:10.563552 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-35b4e4c7-4880-44f8-9c1c-71933f2e9715 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:10.571156 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-35b4e4c7-4880-44f8-9c1c-71933f2e9715 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 200 len: 1321 microversion: 2.1 time: 0.187499 May 23 15:42:10.571726 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 55/104] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:10 2022] GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 1321 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:10.736774 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-42d11017-4632-4617-aa81-a7bd93c45f8b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:10.737496 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-42d11017-4632-4617-aa81-a7bd93c45f8b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:10.744376 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-42d11017-4632-4617-aa81-a7bd93c45f8b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:10.744832 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-42d11017-4632-4617-aa81-a7bd93c45f8b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:10.745825 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-42d11017-4632-4617-aa81-a7bd93c45f8b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:10.746271 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-42d11017-4632-4617-aa81-a7bd93c45f8b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:11.042779 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-42d11017-4632-4617-aa81-a7bd93c45f8b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:11.050742 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-42d11017-4632-4617-aa81-a7bd93c45f8b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 200 len: 1362 microversion: 2.1 time: 0.318539 May 23 15:42:11.051393 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 50/105] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:10 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 1362 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:11.218688 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [req-0ff36c4e-5c66-48d9-a2f6-6174f1974767 req-064da3a9-d14e-4e58-ba4f-810e9099743a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "800dd67c-e6dd-4712-9fe6-8d823b845358", "tag": "f434c841-96a2-4c6e-a73f-0d44004c417c"}]} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:42:11.234299 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-0ff36c4e-5c66-48d9-a2f6-6174f1974767 req-064da3a9-d14e-4e58-ba4f-810e9099743a service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:11.234771 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-0ff36c4e-5c66-48d9-a2f6-6174f1974767 req-064da3a9-d14e-4e58-ba4f-810e9099743a service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:11.251745 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.compute.server_external_events [req-0ff36c4e-5c66-48d9-a2f6-6174f1974767 req-064da3a9-d14e-4e58-ba4f-810e9099743a service nova] Creating event network-changed:f434c841-96a2-4c6e-a73f-0d44004c417c for instance 800dd67c-e6dd-4712-9fe6-8d823b845358 on hv-cinder-84067 May 23 15:42:11.257081 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [req-0ff36c4e-5c66-48d9-a2f6-6174f1974767 req-064da3a9-d14e-4e58-ba4f-810e9099743a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042943 May 23 15:42:11.257880 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 56/106] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:42:11.391838 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-c486284c-0b07-4013-b6ab-e9a14e011f70 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:11.392459 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-c486284c-0b07-4013-b6ab-e9a14e011f70 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] [instance: e30f4234-a3e5-4cf3-8d65-583de8fbca41] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:11.399413 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c486284c-0b07-4013-b6ab-e9a14e011f70 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:11.399930 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c486284c-0b07-4013-b6ab-e9a14e011f70 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:11.400945 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c486284c-0b07-4013-b6ab-e9a14e011f70 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:11.401492 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c486284c-0b07-4013-b6ab-e9a14e011f70 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:11.534994 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-c486284c-0b07-4013-b6ab-e9a14e011f70 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916c7e4c45a94167ba39db8c7fec0d19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a819820263647f784079581c7527921', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:11.542428 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-c486284c-0b07-4013-b6ab-e9a14e011f70 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] 10.222.0.64 "GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41" status: 200 len: 1314 microversion: 2.1 time: 0.155190 May 23 15:42:11.542978 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 51/107] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:11 2022] GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:11.588428 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-8da295b6-d866-4f06-992d-ff01f5192512 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:11.589157 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-8da295b6-d866-4f06-992d-ff01f5192512 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:11.595650 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-8da295b6-d866-4f06-992d-ff01f5192512 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:11.596106 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-8da295b6-d866-4f06-992d-ff01f5192512 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:11.596894 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-8da295b6-d866-4f06-992d-ff01f5192512 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:11.597373 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-8da295b6-d866-4f06-992d-ff01f5192512 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:11.731231 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-8da295b6-d866-4f06-992d-ff01f5192512 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:11.739397 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-8da295b6-d866-4f06-992d-ff01f5192512 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 200 len: 1321 microversion: 2.1 time: 0.155174 May 23 15:42:11.739970 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 57/108] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:11 2022] GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:12.067568 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-13623b50-874c-40a9-a17b-fc2f1d11ae04 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:12.068195 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-13623b50-874c-40a9-a17b-fc2f1d11ae04 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:12.074206 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-13623b50-874c-40a9-a17b-fc2f1d11ae04 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:12.074655 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-13623b50-874c-40a9-a17b-fc2f1d11ae04 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:12.075410 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-13623b50-874c-40a9-a17b-fc2f1d11ae04 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:12.075847 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-13623b50-874c-40a9-a17b-fc2f1d11ae04 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:12.203864 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-13623b50-874c-40a9-a17b-fc2f1d11ae04 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:12.211172 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-13623b50-874c-40a9-a17b-fc2f1d11ae04 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 200 len: 1362 microversion: 2.1 time: 0.147411 May 23 15:42:12.211728 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 52/109] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:12 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:42:12.559651 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-901f8743-414f-4da7-95bf-ab632886bb13 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:12.562284 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-901f8743-414f-4da7-95bf-ab632886bb13 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] [instance: e30f4234-a3e5-4cf3-8d65-583de8fbca41] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:12.568300 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-901f8743-414f-4da7-95bf-ab632886bb13 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:12.568752 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-901f8743-414f-4da7-95bf-ab632886bb13 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:12.569545 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-901f8743-414f-4da7-95bf-ab632886bb13 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:12.569986 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-901f8743-414f-4da7-95bf-ab632886bb13 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:12.704986 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-901f8743-414f-4da7-95bf-ab632886bb13 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916c7e4c45a94167ba39db8c7fec0d19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a819820263647f784079581c7527921', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:12.712851 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-901f8743-414f-4da7-95bf-ab632886bb13 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] 10.222.0.64 "GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41" status: 200 len: 1314 microversion: 2.1 time: 0.157113 May 23 15:42:12.713447 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 58/110] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:12 2022] GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:12.757025 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-9bfcd263-d5fa-4f62-88f6-88875433d773 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:12.757675 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-9bfcd263-d5fa-4f62-88f6-88875433d773 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:12.764236 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-9bfcd263-d5fa-4f62-88f6-88875433d773 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:12.764676 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-9bfcd263-d5fa-4f62-88f6-88875433d773 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:12.765457 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-9bfcd263-d5fa-4f62-88f6-88875433d773 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:12.765885 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-9bfcd263-d5fa-4f62-88f6-88875433d773 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:12.897170 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-9bfcd263-d5fa-4f62-88f6-88875433d773 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:12.905708 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-9bfcd263-d5fa-4f62-88f6-88875433d773 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 200 len: 1321 microversion: 2.1 time: 0.152352 May 23 15:42:12.906355 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 53/111] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:12 2022] GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:13.232007 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-5282aa1c-bdd4-4745-ac58-1600d053d42e tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:13.233399 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-5282aa1c-bdd4-4745-ac58-1600d053d42e tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:13.239384 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5282aa1c-bdd4-4745-ac58-1600d053d42e tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:13.239838 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5282aa1c-bdd4-4745-ac58-1600d053d42e tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:13.240602 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5282aa1c-bdd4-4745-ac58-1600d053d42e tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:13.241039 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5282aa1c-bdd4-4745-ac58-1600d053d42e tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:13.371400 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-5282aa1c-bdd4-4745-ac58-1600d053d42e tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:13.379706 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-5282aa1c-bdd4-4745-ac58-1600d053d42e tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 200 len: 1362 microversion: 2.1 time: 0.154841 May 23 15:42:13.380268 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 59/112] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:13 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:13.730247 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-92ac213e-445e-4019-802c-d9abbb436e4e tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:13.731131 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-92ac213e-445e-4019-802c-d9abbb436e4e tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] [instance: e30f4234-a3e5-4cf3-8d65-583de8fbca41] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:13.738143 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-92ac213e-445e-4019-802c-d9abbb436e4e tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:13.738599 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-92ac213e-445e-4019-802c-d9abbb436e4e tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:13.739362 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-92ac213e-445e-4019-802c-d9abbb436e4e tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:13.739992 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-92ac213e-445e-4019-802c-d9abbb436e4e tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:13.890665 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-92ac213e-445e-4019-802c-d9abbb436e4e tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916c7e4c45a94167ba39db8c7fec0d19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a819820263647f784079581c7527921', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:13.900283 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-92ac213e-445e-4019-802c-d9abbb436e4e tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] 10.222.0.64 "GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41" status: 200 len: 1314 microversion: 2.1 time: 0.173703 May 23 15:42:13.901191 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 54/113] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:13 2022] GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:13.923456 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-072e6cb4-c6fa-4333-83d2-7e9470f96de1 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:13.924101 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-072e6cb4-c6fa-4333-83d2-7e9470f96de1 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:13.931360 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-072e6cb4-c6fa-4333-83d2-7e9470f96de1 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:13.931846 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-072e6cb4-c6fa-4333-83d2-7e9470f96de1 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:13.933095 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-072e6cb4-c6fa-4333-83d2-7e9470f96de1 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:13.933480 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-072e6cb4-c6fa-4333-83d2-7e9470f96de1 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:13.938050 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_cell1:SELECT=100 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:42:14.082744 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-072e6cb4-c6fa-4333-83d2-7e9470f96de1 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:14.090322 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-072e6cb4-c6fa-4333-83d2-7e9470f96de1 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 200 len: 1321 microversion: 2.1 time: 0.171093 May 23 15:42:14.090903 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 60/114] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:13 2022] GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:42:14.396466 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-11c82601-1575-4aff-b136-11d0bc0f974b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:14.397149 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-11c82601-1575-4aff-b136-11d0bc0f974b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:14.403209 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-11c82601-1575-4aff-b136-11d0bc0f974b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:14.403650 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-11c82601-1575-4aff-b136-11d0bc0f974b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:14.404406 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-11c82601-1575-4aff-b136-11d0bc0f974b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:14.404901 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-11c82601-1575-4aff-b136-11d0bc0f974b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:14.758269 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-11c82601-1575-4aff-b136-11d0bc0f974b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:14.766799 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-11c82601-1575-4aff-b136-11d0bc0f974b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 200 len: 1362 microversion: 2.1 time: 0.374153 May 23 15:42:14.769228 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 55/115] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:14 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 1362 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:14.922939 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-98e0e27b-bcb3-4415-901e-c87a0c4e485c tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:14.923571 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-98e0e27b-bcb3-4415-901e-c87a0c4e485c tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] [instance: e30f4234-a3e5-4cf3-8d65-583de8fbca41] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:14.930752 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-98e0e27b-bcb3-4415-901e-c87a0c4e485c tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:14.931438 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-98e0e27b-bcb3-4415-901e-c87a0c4e485c tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:14.932369 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-98e0e27b-bcb3-4415-901e-c87a0c4e485c tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:14.932962 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-98e0e27b-bcb3-4415-901e-c87a0c4e485c tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:15.110677 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-b44d3147-c18b-41c8-b73d-885281c4d52c tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:15.111966 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-b44d3147-c18b-41c8-b73d-885281c4d52c tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:15.121515 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b44d3147-c18b-41c8-b73d-885281c4d52c tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:15.124100 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b44d3147-c18b-41c8-b73d-885281c4d52c tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:15.125485 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b44d3147-c18b-41c8-b73d-885281c4d52c tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:15.126043 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b44d3147-c18b-41c8-b73d-885281c4d52c tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:15.156268 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_cell1:SELECT=100 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:42:15.508326 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-98e0e27b-bcb3-4415-901e-c87a0c4e485c tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916c7e4c45a94167ba39db8c7fec0d19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a819820263647f784079581c7527921', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:15.517549 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-98e0e27b-bcb3-4415-901e-c87a0c4e485c tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] 10.222.0.64 "GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41" status: 200 len: 1314 microversion: 2.1 time: 0.601029 May 23 15:42:15.518524 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 61/116] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:14 2022] GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41 => generated 1314 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:15.547694 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-b44d3147-c18b-41c8-b73d-885281c4d52c tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:15.556242 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-b44d3147-c18b-41c8-b73d-885281c4d52c tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 200 len: 1321 microversion: 2.1 time: 0.451478 May 23 15:42:15.557330 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 56/117] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:15 2022] GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 1321 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:15.785707 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-ca22f424-6d61-4a09-a4fd-e775d0be1348 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:15.786555 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-ca22f424-6d61-4a09-a4fd-e775d0be1348 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:15.788559 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_cell0:SELECT=2 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:42:15.793885 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ca22f424-6d61-4a09-a4fd-e775d0be1348 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:15.794506 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ca22f424-6d61-4a09-a4fd-e775d0be1348 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:15.796123 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ca22f424-6d61-4a09-a4fd-e775d0be1348 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:15.796718 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ca22f424-6d61-4a09-a4fd-e775d0be1348 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:16.097627 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [req-2daf5be1-d614-40be-bd62-1dc4d3055ef9 req-e3970030-467b-4e25-ba6d-8cd96c26d47f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbe72f52-c8f9-46ea-ae59-9d2fe0a49523", "name": "network-vif-plugged", "status": "completed", "tag": "d9ed8cc1-0b96-4f2b-a6a8-4413cb65225f"}]} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:42:16.125001 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-2daf5be1-d614-40be-bd62-1dc4d3055ef9 req-e3970030-467b-4e25-ba6d-8cd96c26d47f service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:16.125001 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-2daf5be1-d614-40be-bd62-1dc4d3055ef9 req-e3970030-467b-4e25-ba6d-8cd96c26d47f service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:16.159092 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.compute.server_external_events [req-2daf5be1-d614-40be-bd62-1dc4d3055ef9 req-e3970030-467b-4e25-ba6d-8cd96c26d47f service nova] Creating event network-vif-plugged:d9ed8cc1-0b96-4f2b-a6a8-4413cb65225f for instance bbe72f52-c8f9-46ea-ae59-9d2fe0a49523 on hv-cinder-84067 May 23 15:42:16.160268 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-2daf5be1-d614-40be-bd62-1dc4d3055ef9 req-e3970030-467b-4e25-ba6d-8cd96c26d47f service nova] Acquired lock "compute-rpcapi-router" {{(pid=124933) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 23 15:42:16.162198 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-dfbf5b52-6cb7-4ed5-ac17-b8a5fac79ce4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:16.163318 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-dfbf5b52-6cb7-4ed5-ac17-b8a5fac79ce4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:16.164119 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-dfbf5b52-6cb7-4ed5-ac17-b8a5fac79ce4 None None] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:16.164554 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-dfbf5b52-6cb7-4ed5-ac17-b8a5fac79ce4 None None] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:16.175864 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.compute.rpcapi [None req-dfbf5b52-6cb7-4ed5-ac17-b8a5fac79ce4 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 23 15:42:16.176986 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-dfbf5b52-6cb7-4ed5-ac17-b8a5fac79ce4 None None] Releasing lock "compute-rpcapi-router" {{(pid=124933) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 23 15:42:16.198081 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-dfbf5b52-6cb7-4ed5-ac17-b8a5fac79ce4 None None] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.190639 May 23 15:42:16.199045 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 57/118] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:42:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:42:16.290981 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-ca22f424-6d61-4a09-a4fd-e775d0be1348 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:16.299731 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-ca22f424-6d61-4a09-a4fd-e775d0be1348 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 200 len: 1362 microversion: 2.1 time: 0.517944 May 23 15:42:16.300294 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 62/119] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:15 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 1362 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:16.535857 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-efcafdfb-1e1c-4ba5-8482-f6839b6d7f86 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:16.536548 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-efcafdfb-1e1c-4ba5-8482-f6839b6d7f86 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] [instance: e30f4234-a3e5-4cf3-8d65-583de8fbca41] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:16.542864 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-efcafdfb-1e1c-4ba5-8482-f6839b6d7f86 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:16.543308 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-efcafdfb-1e1c-4ba5-8482-f6839b6d7f86 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:16.544321 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-efcafdfb-1e1c-4ba5-8482-f6839b6d7f86 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:16.544743 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-efcafdfb-1e1c-4ba5-8482-f6839b6d7f86 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:16.574739 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-9a1612d7-1677-4799-b3c9-fef8bfd4dee2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:16.575532 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-9a1612d7-1677-4799-b3c9-fef8bfd4dee2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:16.581734 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-9a1612d7-1677-4799-b3c9-fef8bfd4dee2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:16.582210 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-9a1612d7-1677-4799-b3c9-fef8bfd4dee2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:16.582952 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-9a1612d7-1677-4799-b3c9-fef8bfd4dee2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:16.583385 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-9a1612d7-1677-4799-b3c9-fef8bfd4dee2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:16.781694 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-efcafdfb-1e1c-4ba5-8482-f6839b6d7f86 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916c7e4c45a94167ba39db8c7fec0d19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a819820263647f784079581c7527921', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:16.789119 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-efcafdfb-1e1c-4ba5-8482-f6839b6d7f86 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] 10.222.0.64 "GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41" status: 200 len: 1314 microversion: 2.1 time: 0.257449 May 23 15:42:16.789687 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 58/120] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:16 2022] GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41 => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:42:16.796590 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-9a1612d7-1677-4799-b3c9-fef8bfd4dee2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:16.804147 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-9a1612d7-1677-4799-b3c9-fef8bfd4dee2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 200 len: 1321 microversion: 2.1 time: 0.233403 May 23 15:42:16.804694 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 63/121] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:16 2022] GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 1321 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:42:17.316740 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-523cf912-48f4-4a02-9d99-299b86abbfd6 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:17.317389 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-523cf912-48f4-4a02-9d99-299b86abbfd6 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:17.325007 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-523cf912-48f4-4a02-9d99-299b86abbfd6 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:17.325484 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-523cf912-48f4-4a02-9d99-299b86abbfd6 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:17.327994 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-523cf912-48f4-4a02-9d99-299b86abbfd6 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:17.327994 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-523cf912-48f4-4a02-9d99-299b86abbfd6 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:17.516497 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-523cf912-48f4-4a02-9d99-299b86abbfd6 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:17.524515 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-523cf912-48f4-4a02-9d99-299b86abbfd6 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 200 len: 1362 microversion: 2.1 time: 0.212355 May 23 15:42:17.525734 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 59/122] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:17 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 1362 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:17.806632 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-e60e3138-735a-4fa7-9bcc-05a5c27c9a66 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:17.807248 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-e60e3138-735a-4fa7-9bcc-05a5c27c9a66 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] [instance: e30f4234-a3e5-4cf3-8d65-583de8fbca41] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:17.816779 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e60e3138-735a-4fa7-9bcc-05a5c27c9a66 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:17.819364 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e60e3138-735a-4fa7-9bcc-05a5c27c9a66 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:17.820385 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e60e3138-735a-4fa7-9bcc-05a5c27c9a66 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:17.820988 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e60e3138-735a-4fa7-9bcc-05a5c27c9a66 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:17.827833 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-e4145621-44fa-4ec3-bfe9-341f6b41e435 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:17.828445 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-e4145621-44fa-4ec3-bfe9-341f6b41e435 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:17.852251 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e4145621-44fa-4ec3-bfe9-341f6b41e435 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:17.852714 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e4145621-44fa-4ec3-bfe9-341f6b41e435 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:17.853691 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e4145621-44fa-4ec3-bfe9-341f6b41e435 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:17.854150 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e4145621-44fa-4ec3-bfe9-341f6b41e435 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:18.082299 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-e60e3138-735a-4fa7-9bcc-05a5c27c9a66 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916c7e4c45a94167ba39db8c7fec0d19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a819820263647f784079581c7527921', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:18.093782 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-e60e3138-735a-4fa7-9bcc-05a5c27c9a66 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] 10.222.0.64 "GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41" status: 200 len: 1314 microversion: 2.1 time: 0.291386 May 23 15:42:18.102418 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-e4145621-44fa-4ec3-bfe9-341f6b41e435 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:18.104259 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 64/123] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:17 2022] GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41 => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:18.110249 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-e4145621-44fa-4ec3-bfe9-341f6b41e435 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 200 len: 1321 microversion: 2.1 time: 0.286519 May 23 15:42:18.110814 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 60/124] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:17 2022] GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 1321 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:18.223743 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [req-8d12bc45-c0ba-415c-8ae4-66f4d113d1a7 req-871a29a8-f8c0-43fe-8faa-575393980977 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1210ee26-89ef-4f9e-b0e9-9534c3dd9d09", "name": "network-vif-plugged", "status": "completed", "tag": "e89cca66-d50b-4f6c-a342-f64ba7767359"}]} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:42:18.239667 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-8d12bc45-c0ba-415c-8ae4-66f4d113d1a7 req-871a29a8-f8c0-43fe-8faa-575393980977 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:18.240350 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-8d12bc45-c0ba-415c-8ae4-66f4d113d1a7 req-871a29a8-f8c0-43fe-8faa-575393980977 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:18.259503 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.compute.server_external_events [req-8d12bc45-c0ba-415c-8ae4-66f4d113d1a7 req-871a29a8-f8c0-43fe-8faa-575393980977 service nova] Creating event network-vif-plugged:e89cca66-d50b-4f6c-a342-f64ba7767359 for instance 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 on hv-cinder-84067 May 23 15:42:18.267006 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [req-8d12bc45-c0ba-415c-8ae4-66f4d113d1a7 req-871a29a8-f8c0-43fe-8faa-575393980977 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047210 May 23 15:42:18.268387 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 65/125] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:42:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:42:18.542657 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-1c9ecc90-d03e-48a0-8264-d7177a25980a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:18.543224 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-1c9ecc90-d03e-48a0-8264-d7177a25980a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:18.549850 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1c9ecc90-d03e-48a0-8264-d7177a25980a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:18.550348 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1c9ecc90-d03e-48a0-8264-d7177a25980a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:18.551255 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1c9ecc90-d03e-48a0-8264-d7177a25980a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:18.551699 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1c9ecc90-d03e-48a0-8264-d7177a25980a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:18.705396 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-1c9ecc90-d03e-48a0-8264-d7177a25980a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:18.713851 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-1c9ecc90-d03e-48a0-8264-d7177a25980a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 200 len: 1362 microversion: 2.1 time: 0.175106 May 23 15:42:18.714462 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 61/126] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:18 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:19.113888 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-a2b0df61-6cfd-4f76-ae47-d622f32878a0 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:19.113888 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-a2b0df61-6cfd-4f76-ae47-d622f32878a0 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] [instance: e30f4234-a3e5-4cf3-8d65-583de8fbca41] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:19.128977 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-8331cc3e-e7d9-41f0-b4a5-2b84f748687b tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:19.129621 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-8331cc3e-e7d9-41f0-b4a5-2b84f748687b tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:19.137238 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-8331cc3e-e7d9-41f0-b4a5-2b84f748687b tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:19.140090 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-8331cc3e-e7d9-41f0-b4a5-2b84f748687b tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:19.140090 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-8331cc3e-e7d9-41f0-b4a5-2b84f748687b tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:19.140090 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-8331cc3e-e7d9-41f0-b4a5-2b84f748687b tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:19.142566 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-a2b0df61-6cfd-4f76-ae47-d622f32878a0 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:19.143021 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-a2b0df61-6cfd-4f76-ae47-d622f32878a0 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:19.143799 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-a2b0df61-6cfd-4f76-ae47-d622f32878a0 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:19.144240 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-a2b0df61-6cfd-4f76-ae47-d622f32878a0 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:19.413555 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-a2b0df61-6cfd-4f76-ae47-d622f32878a0 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916c7e4c45a94167ba39db8c7fec0d19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a819820263647f784079581c7527921', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:19.423883 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-a2b0df61-6cfd-4f76-ae47-d622f32878a0 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] 10.222.0.64 "GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41" status: 200 len: 1314 microversion: 2.1 time: 0.316577 May 23 15:42:19.425514 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 66/127] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:19 2022] GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41 => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:19.431351 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-8331cc3e-e7d9-41f0-b4a5-2b84f748687b tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:19.439727 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-8331cc3e-e7d9-41f0-b4a5-2b84f748687b tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 200 len: 1321 microversion: 2.1 time: 0.315210 May 23 15:42:19.440736 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 62/128] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:19 2022] GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 1321 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:42:19.738059 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-f9b0383e-421d-469f-abdc-566fdb7ce79b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:19.740458 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-f9b0383e-421d-469f-abdc-566fdb7ce79b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:19.761516 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-f9b0383e-421d-469f-abdc-566fdb7ce79b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:19.763012 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-f9b0383e-421d-469f-abdc-566fdb7ce79b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:19.767478 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-f9b0383e-421d-469f-abdc-566fdb7ce79b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:19.767931 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-f9b0383e-421d-469f-abdc-566fdb7ce79b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:19.947377 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-f9b0383e-421d-469f-abdc-566fdb7ce79b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:19.958405 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-f9b0383e-421d-469f-abdc-566fdb7ce79b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 200 len: 1362 microversion: 2.1 time: 0.231188 May 23 15:42:19.958979 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 67/129] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:19 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 1362 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:20.282638 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [req-d5c7c1f2-17fe-46b5-86df-929f7c69aeb2 req-0c449537-4fc1-4600-be4e-6eb6a7208d2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e30f4234-a3e5-4cf3-8d65-583de8fbca41", "name": "network-vif-plugged", "status": "completed", "tag": "620fab52-b890-4499-b5f7-e33158b7c317"}]} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:42:20.291325 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-d5c7c1f2-17fe-46b5-86df-929f7c69aeb2 req-0c449537-4fc1-4600-be4e-6eb6a7208d2a service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:20.291514 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-d5c7c1f2-17fe-46b5-86df-929f7c69aeb2 req-0c449537-4fc1-4600-be4e-6eb6a7208d2a service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:20.303882 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.compute.server_external_events [req-d5c7c1f2-17fe-46b5-86df-929f7c69aeb2 req-0c449537-4fc1-4600-be4e-6eb6a7208d2a service nova] Creating event network-vif-plugged:620fab52-b890-4499-b5f7-e33158b7c317 for instance e30f4234-a3e5-4cf3-8d65-583de8fbca41 on hv-cinder-84067 May 23 15:42:20.308817 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [req-d5c7c1f2-17fe-46b5-86df-929f7c69aeb2 req-0c449537-4fc1-4600-be4e-6eb6a7208d2a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030543 May 23 15:42:20.309522 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 63/130] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:42:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:42:20.442836 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-8a7c984b-8053-44a3-ab0b-6706ab67db31 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:20.443856 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-8a7c984b-8053-44a3-ab0b-6706ab67db31 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] [instance: e30f4234-a3e5-4cf3-8d65-583de8fbca41] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:20.450015 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-8a7c984b-8053-44a3-ab0b-6706ab67db31 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:20.450468 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-8a7c984b-8053-44a3-ab0b-6706ab67db31 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:20.452042 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-8a7c984b-8053-44a3-ab0b-6706ab67db31 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:20.452587 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-8a7c984b-8053-44a3-ab0b-6706ab67db31 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:20.460565 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-d00f575d-1f1e-4191-9a50-d6fb13464d4b tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:20.461673 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-d00f575d-1f1e-4191-9a50-d6fb13464d4b tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:20.471651 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-d00f575d-1f1e-4191-9a50-d6fb13464d4b tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:20.472123 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-d00f575d-1f1e-4191-9a50-d6fb13464d4b tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:20.490474 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-d00f575d-1f1e-4191-9a50-d6fb13464d4b tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:20.490474 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-d00f575d-1f1e-4191-9a50-d6fb13464d4b tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:20.701751 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-8a7c984b-8053-44a3-ab0b-6706ab67db31 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916c7e4c45a94167ba39db8c7fec0d19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a819820263647f784079581c7527921', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:20.719584 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-d00f575d-1f1e-4191-9a50-d6fb13464d4b tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:20.719865 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-8a7c984b-8053-44a3-ab0b-6706ab67db31 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] 10.222.0.64 "GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41" status: 200 len: 1314 microversion: 2.1 time: 0.275218 May 23 15:42:20.719865 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 68/131] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:20 2022] GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41 => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:20.722116 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-d00f575d-1f1e-4191-9a50-d6fb13464d4b tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 200 len: 1321 microversion: 2.1 time: 0.265663 May 23 15:42:20.722676 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 64/132] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:20 2022] GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 1321 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:20.975723 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-d7b4b692-83ae-4b50-afb8-304f62654055 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:20.976322 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-d7b4b692-83ae-4b50-afb8-304f62654055 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:20.983014 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-d7b4b692-83ae-4b50-afb8-304f62654055 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:20.983464 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-d7b4b692-83ae-4b50-afb8-304f62654055 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:20.984227 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-d7b4b692-83ae-4b50-afb8-304f62654055 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:20.984663 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-d7b4b692-83ae-4b50-afb8-304f62654055 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:21.116484 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-d7b4b692-83ae-4b50-afb8-304f62654055 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:21.123974 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-d7b4b692-83ae-4b50-afb8-304f62654055 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 200 len: 1362 microversion: 2.1 time: 0.152109 May 23 15:42:21.124538 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 69/133] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:20 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:21.729900 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-e13fae03-ebf5-4aac-b05e-360a5c11b710 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:21.730514 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-e13fae03-ebf5-4aac-b05e-360a5c11b710 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] [instance: e30f4234-a3e5-4cf3-8d65-583de8fbca41] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:21.738497 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e13fae03-ebf5-4aac-b05e-360a5c11b710 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:21.742790 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e13fae03-ebf5-4aac-b05e-360a5c11b710 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:21.742790 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e13fae03-ebf5-4aac-b05e-360a5c11b710 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:21.742790 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e13fae03-ebf5-4aac-b05e-360a5c11b710 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:21.743133 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-acc7c4ae-ffc4-47ca-be4d-42b7b795bdb7 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:21.743133 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-acc7c4ae-ffc4-47ca-be4d-42b7b795bdb7 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:21.747262 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-acc7c4ae-ffc4-47ca-be4d-42b7b795bdb7 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:21.747717 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-acc7c4ae-ffc4-47ca-be4d-42b7b795bdb7 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:21.748594 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-acc7c4ae-ffc4-47ca-be4d-42b7b795bdb7 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:21.749115 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-acc7c4ae-ffc4-47ca-be4d-42b7b795bdb7 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:21.964089 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-e13fae03-ebf5-4aac-b05e-360a5c11b710 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916c7e4c45a94167ba39db8c7fec0d19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a819820263647f784079581c7527921', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:21.967941 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-acc7c4ae-ffc4-47ca-be4d-42b7b795bdb7 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:21.972804 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-e13fae03-ebf5-4aac-b05e-360a5c11b710 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] 10.222.0.64 "GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41" status: 200 len: 1314 microversion: 2.1 time: 0.246533 May 23 15:42:21.973871 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 65/134] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:21 2022] GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41 => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:22.005658 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-acc7c4ae-ffc4-47ca-be4d-42b7b795bdb7 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 200 len: 1513 microversion: 2.1 time: 0.251572 May 23 15:42:22.005658 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 70/135] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:21 2022] GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 1513 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:42:22.017469 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-c72bd360-ccc4-4514-9211-960ec8edb115 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:42:22.018456 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-c72bd360-ccc4-4514-9211-960ec8edb115 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:22.032178 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c72bd360-ccc4-4514-9211-960ec8edb115 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:22.032644 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c72bd360-ccc4-4514-9211-960ec8edb115 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:22.034832 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c72bd360-ccc4-4514-9211-960ec8edb115 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:22.034832 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c72bd360-ccc4-4514-9211-960ec8edb115 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:22.095286 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.objects.instance [None req-c72bd360-ccc4-4514-9211-960ec8edb115 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lazy-loading 'flavor' on Instance uuid 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 {{(pid=124933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 15:42:22.140815 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-79fb43ca-0ee1-479c-90be-da1b56471af3 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:22.141476 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-79fb43ca-0ee1-479c-90be-da1b56471af3 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:22.150048 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-79fb43ca-0ee1-479c-90be-da1b56471af3 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:22.150737 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-79fb43ca-0ee1-479c-90be-da1b56471af3 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:22.153242 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-79fb43ca-0ee1-479c-90be-da1b56471af3 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:22.158826 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-79fb43ca-0ee1-479c-90be-da1b56471af3 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:22.363478 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-79fb43ca-0ee1-479c-90be-da1b56471af3 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:22.371486 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-79fb43ca-0ee1-479c-90be-da1b56471af3 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 200 len: 1362 microversion: 2.1 time: 0.235327 May 23 15:42:22.372075 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 71/136] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:22 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 1362 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:42:22.387606 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [req-492fa2bf-4335-4769-ba56-07f2f2d6ba9b req-f429a7b9-e989-4eed-b62b-344286eb3ba0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "800dd67c-e6dd-4712-9fe6-8d823b845358", "name": "network-vif-plugged", "status": "completed", "tag": "f434c841-96a2-4c6e-a73f-0d44004c417c"}]} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:42:22.396519 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-492fa2bf-4335-4769-ba56-07f2f2d6ba9b req-f429a7b9-e989-4eed-b62b-344286eb3ba0 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:22.396969 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-492fa2bf-4335-4769-ba56-07f2f2d6ba9b req-f429a7b9-e989-4eed-b62b-344286eb3ba0 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:22.410320 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.compute.server_external_events [req-492fa2bf-4335-4769-ba56-07f2f2d6ba9b req-f429a7b9-e989-4eed-b62b-344286eb3ba0 service nova] Creating event network-vif-plugged:f434c841-96a2-4c6e-a73f-0d44004c417c for instance 800dd67c-e6dd-4712-9fe6-8d823b845358 on hv-cinder-84067 May 23 15:42:22.415990 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [req-492fa2bf-4335-4769-ba56-07f2f2d6ba9b req-f429a7b9-e989-4eed-b62b-344286eb3ba0 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041245 May 23 15:42:22.416655 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 72/137] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:42:22.704122 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-c72bd360-ccc4-4514-9211-960ec8edb115 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "POST /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09/action" status: 200 len: 32 microversion: 2.1 time: 0.682182 May 23 15:42:22.704122 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 66/138] 10.222.0.64 () {60 vars in 1277 bytes} [Mon May 23 15:42:22 2022] POST /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09/action => generated 32 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 15:42:22.712210 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-3bf09be1-1616-4dec-97d3-f46cefa8289e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:22.713327 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-3bf09be1-1616-4dec-97d3-f46cefa8289e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:22.720756 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3bf09be1-1616-4dec-97d3-f46cefa8289e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:22.721445 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3bf09be1-1616-4dec-97d3-f46cefa8289e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:22.722457 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3bf09be1-1616-4dec-97d3-f46cefa8289e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:22.723220 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3bf09be1-1616-4dec-97d3-f46cefa8289e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:22.873728 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-3bf09be1-1616-4dec-97d3-f46cefa8289e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:22.882876 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-3bf09be1-1616-4dec-97d3-f46cefa8289e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 200 len: 1519 microversion: 2.1 time: 0.176387 May 23 15:42:22.883460 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 73/139] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:22 2022] GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 1519 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:42:23.076717 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-02b74d00-6c12-4657-8a31-06e504197c08 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:23.076717 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-02b74d00-6c12-4657-8a31-06e504197c08 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] [instance: e30f4234-a3e5-4cf3-8d65-583de8fbca41] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:23.076717 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-02b74d00-6c12-4657-8a31-06e504197c08 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:23.076717 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-02b74d00-6c12-4657-8a31-06e504197c08 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:23.078044 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-02b74d00-6c12-4657-8a31-06e504197c08 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:23.078044 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-02b74d00-6c12-4657-8a31-06e504197c08 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:23.164613 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-02b74d00-6c12-4657-8a31-06e504197c08 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916c7e4c45a94167ba39db8c7fec0d19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a819820263647f784079581c7527921', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:23.173287 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-02b74d00-6c12-4657-8a31-06e504197c08 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] 10.222.0.64 "GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41" status: 200 len: 1314 microversion: 2.1 time: 0.186537 May 23 15:42:23.173850 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 67/140] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:22 2022] GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:23.393331 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-0acfaa90-fcf1-424e-b447-d1e011296cf9 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:23.393938 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-0acfaa90-fcf1-424e-b447-d1e011296cf9 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:23.400280 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0acfaa90-fcf1-424e-b447-d1e011296cf9 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:23.400762 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0acfaa90-fcf1-424e-b447-d1e011296cf9 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:23.401560 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0acfaa90-fcf1-424e-b447-d1e011296cf9 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:23.401993 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0acfaa90-fcf1-424e-b447-d1e011296cf9 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:23.551400 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-0acfaa90-fcf1-424e-b447-d1e011296cf9 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:23.561797 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-0acfaa90-fcf1-424e-b447-d1e011296cf9 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 200 len: 1362 microversion: 2.1 time: 0.172322 May 23 15:42:23.562548 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 74/141] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:23 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:23.899716 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-de006d59-d018-49fd-a7e4-16124bee2363 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:23.900527 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-de006d59-d018-49fd-a7e4-16124bee2363 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:23.907312 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-de006d59-d018-49fd-a7e4-16124bee2363 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:23.908040 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-de006d59-d018-49fd-a7e4-16124bee2363 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:23.908582 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-de006d59-d018-49fd-a7e4-16124bee2363 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:23.909218 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-de006d59-d018-49fd-a7e4-16124bee2363 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:24.071981 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-de006d59-d018-49fd-a7e4-16124bee2363 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:24.079641 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-de006d59-d018-49fd-a7e4-16124bee2363 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 200 len: 1519 microversion: 2.1 time: 0.183709 May 23 15:42:24.081048 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 68/142] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:23 2022] GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 1519 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:24.191126 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-9322a6ae-b337-41bd-9c81-bd540ec9aed3 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:24.192840 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-9322a6ae-b337-41bd-9c81-bd540ec9aed3 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] [instance: e30f4234-a3e5-4cf3-8d65-583de8fbca41] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:24.199306 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-9322a6ae-b337-41bd-9c81-bd540ec9aed3 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:24.199765 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-9322a6ae-b337-41bd-9c81-bd540ec9aed3 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:24.200581 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-9322a6ae-b337-41bd-9c81-bd540ec9aed3 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:24.201025 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-9322a6ae-b337-41bd-9c81-bd540ec9aed3 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:24.501842 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-9322a6ae-b337-41bd-9c81-bd540ec9aed3 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916c7e4c45a94167ba39db8c7fec0d19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a819820263647f784079581c7527921', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:24.509985 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-9322a6ae-b337-41bd-9c81-bd540ec9aed3 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] 10.222.0.64 "GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41" status: 200 len: 1500 microversion: 2.1 time: 0.323204 May 23 15:42:24.521688 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 75/143] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:24 2022] GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41 => generated 1500 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:42:24.578844 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-c2895ee4-355a-4392-95e3-21014e79a453 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:24.579365 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-c2895ee4-355a-4392-95e3-21014e79a453 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:24.585951 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c2895ee4-355a-4392-95e3-21014e79a453 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:24.586553 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c2895ee4-355a-4392-95e3-21014e79a453 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:24.587439 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c2895ee4-355a-4392-95e3-21014e79a453 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:24.587994 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c2895ee4-355a-4392-95e3-21014e79a453 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:24.744697 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-c2895ee4-355a-4392-95e3-21014e79a453 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:24.752252 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-c2895ee4-355a-4392-95e3-21014e79a453 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 200 len: 1362 microversion: 2.1 time: 0.177411 May 23 15:42:24.752819 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 69/144] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:24 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:25.101833 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-608d9991-c01a-4bd4-b3ac-951cd16978ae tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:25.102968 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-608d9991-c01a-4bd4-b3ac-951cd16978ae tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:25.110181 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-608d9991-c01a-4bd4-b3ac-951cd16978ae tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:25.110896 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-608d9991-c01a-4bd4-b3ac-951cd16978ae tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:25.111768 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-608d9991-c01a-4bd4-b3ac-951cd16978ae tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:25.112302 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-608d9991-c01a-4bd4-b3ac-951cd16978ae tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:25.307294 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-608d9991-c01a-4bd4-b3ac-951cd16978ae tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:25.316824 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-608d9991-c01a-4bd4-b3ac-951cd16978ae tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 200 len: 1519 microversion: 2.1 time: 0.222170 May 23 15:42:25.317848 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 76/145] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:25 2022] GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 1519 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:25.770867 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-289bc5f6-7072-43c9-8f63-a3f8920e9183 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:25.771660 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-289bc5f6-7072-43c9-8f63-a3f8920e9183 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:25.778269 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-289bc5f6-7072-43c9-8f63-a3f8920e9183 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:25.779399 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-289bc5f6-7072-43c9-8f63-a3f8920e9183 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:25.779503 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-289bc5f6-7072-43c9-8f63-a3f8920e9183 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:25.780081 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-289bc5f6-7072-43c9-8f63-a3f8920e9183 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:25.979014 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-289bc5f6-7072-43c9-8f63-a3f8920e9183 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:25.990519 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-289bc5f6-7072-43c9-8f63-a3f8920e9183 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 200 len: 1362 microversion: 2.1 time: 0.223850 May 23 15:42:25.995954 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 70/146] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:25 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 1362 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:26.334127 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-c5866ff0-e3b5-4b04-9252-f508b4175987 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:26.334662 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-c5866ff0-e3b5-4b04-9252-f508b4175987 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:26.340742 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-c5866ff0-e3b5-4b04-9252-f508b4175987 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:26.341231 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-c5866ff0-e3b5-4b04-9252-f508b4175987 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:26.342001 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-c5866ff0-e3b5-4b04-9252-f508b4175987 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:26.342543 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-c5866ff0-e3b5-4b04-9252-f508b4175987 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:26.488744 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-49737cd4-ec08-4a9d-82f8-793200aaf9d0 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2288e62c-b85c-40ed-8538-f002beeabcba"}} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:42:26.490320 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-49737cd4-ec08-4a9d-82f8-793200aaf9d0 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] [instance: e30f4234-a3e5-4cf3-8d65-583de8fbca41] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:26.493485 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_cell0:SELECT=2 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:42:26.504989 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-49737cd4-ec08-4a9d-82f8-793200aaf9d0 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:26.505537 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-49737cd4-ec08-4a9d-82f8-793200aaf9d0 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:26.506451 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-49737cd4-ec08-4a9d-82f8-793200aaf9d0 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:26.506875 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-49737cd4-ec08-4a9d-82f8-793200aaf9d0 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:26.529293 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-c5866ff0-e3b5-4b04-9252-f508b4175987 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:26.540126 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-c5866ff0-e3b5-4b04-9252-f508b4175987 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 200 len: 1519 microversion: 2.1 time: 0.207262 May 23 15:42:26.541818 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 77/147] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:26 2022] GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 1519 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:26.664742 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:42:27.007779 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-8ff5c73b-9b09-4211-9152-dbe094ce2570 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:27.008399 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-8ff5c73b-9b09-4211-9152-dbe094ce2570 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:27.018623 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-8ff5c73b-9b09-4211-9152-dbe094ce2570 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:27.019082 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-8ff5c73b-9b09-4211-9152-dbe094ce2570 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:27.021435 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-8ff5c73b-9b09-4211-9152-dbe094ce2570 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:27.022057 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-8ff5c73b-9b09-4211-9152-dbe094ce2570 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:27.042518 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_cell1:SELECT=100 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:42:27.169804 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-8ff5c73b-9b09-4211-9152-dbe094ce2570 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:27.177289 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-8ff5c73b-9b09-4211-9152-dbe094ce2570 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 200 len: 1547 microversion: 2.1 time: 0.173273 May 23 15:42:27.178036 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 78/148] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:27 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 1547 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:27.194696 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-52b9ea13-37fb-4c92-86ca-7ab1403cf56c tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:27.202405 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-52b9ea13-37fb-4c92-86ca-7ab1403cf56c tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:27.202405 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-52b9ea13-37fb-4c92-86ca-7ab1403cf56c tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:27.202405 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-52b9ea13-37fb-4c92-86ca-7ab1403cf56c tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:27.203302 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-52b9ea13-37fb-4c92-86ca-7ab1403cf56c tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:27.203750 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-52b9ea13-37fb-4c92-86ca-7ab1403cf56c tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:27.497541 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-52b9ea13-37fb-4c92-86ca-7ab1403cf56c tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.306300 May 23 15:42:27.498266 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 79/149] 10.222.0.64 () {58 vars in 1274 bytes} [Mon May 23 15:42:27 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358/os-interface => generated 284 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:42:27.558356 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-a5525e52-761c-44d7-a5ef-26a759d37f4f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:27.558969 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-a5525e52-761c-44d7-a5ef-26a759d37f4f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:27.565797 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-a5525e52-761c-44d7-a5ef-26a759d37f4f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:27.566250 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-a5525e52-761c-44d7-a5ef-26a759d37f4f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:27.567020 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-a5525e52-761c-44d7-a5ef-26a759d37f4f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:27.567455 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-a5525e52-761c-44d7-a5ef-26a759d37f4f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:27.856094 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-a5525e52-761c-44d7-a5ef-26a759d37f4f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:27.864729 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-a5525e52-761c-44d7-a5ef-26a759d37f4f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 200 len: 1519 microversion: 2.1 time: 0.310259 May 23 15:42:27.865769 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 80/150] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:27 2022] GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 1519 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:42:28.887804 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-0ea24ddc-07e6-4045-8f02-9db097323cdd tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:28.889331 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-0ea24ddc-07e6-4045-8f02-9db097323cdd tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:28.896408 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0ea24ddc-07e6-4045-8f02-9db097323cdd tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:28.897211 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0ea24ddc-07e6-4045-8f02-9db097323cdd tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:28.898182 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0ea24ddc-07e6-4045-8f02-9db097323cdd tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:28.899122 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0ea24ddc-07e6-4045-8f02-9db097323cdd tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:29.186874 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-0ea24ddc-07e6-4045-8f02-9db097323cdd tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:29.197767 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-0ea24ddc-07e6-4045-8f02-9db097323cdd tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 200 len: 1519 microversion: 2.1 time: 0.316692 May 23 15:42:29.198557 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 81/151] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:28 2022] GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 1519 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:42:29.267663 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [req-d826e081-e36a-408c-9551-5cddf3cf5b66 req-2ecaa1a8-1d9b-46bf-a5e3-383af5fd064e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "800dd67c-e6dd-4712-9fe6-8d823b845358", "tag": "f434c841-96a2-4c6e-a73f-0d44004c417c"}]} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:42:29.275898 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-d826e081-e36a-408c-9551-5cddf3cf5b66 req-2ecaa1a8-1d9b-46bf-a5e3-383af5fd064e service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:29.276932 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-d826e081-e36a-408c-9551-5cddf3cf5b66 req-2ecaa1a8-1d9b-46bf-a5e3-383af5fd064e service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:29.288983 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.compute.server_external_events [req-d826e081-e36a-408c-9551-5cddf3cf5b66 req-2ecaa1a8-1d9b-46bf-a5e3-383af5fd064e service nova] Creating event network-changed:f434c841-96a2-4c6e-a73f-0d44004c417c for instance 800dd67c-e6dd-4712-9fe6-8d823b845358 on hv-cinder-84067 May 23 15:42:29.296181 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [req-d826e081-e36a-408c-9551-5cddf3cf5b66 req-2ecaa1a8-1d9b-46bf-a5e3-383af5fd064e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033046 May 23 15:42:29.303284 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 82/152] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:42:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:42:30.217323 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-e67ac96f-220d-4cc6-a955-fbde8895a0fb tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:30.217323 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-e67ac96f-220d-4cc6-a955-fbde8895a0fb tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:30.223738 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e67ac96f-220d-4cc6-a955-fbde8895a0fb tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:30.224672 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e67ac96f-220d-4cc6-a955-fbde8895a0fb tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:30.225519 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e67ac96f-220d-4cc6-a955-fbde8895a0fb tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:30.225977 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e67ac96f-220d-4cc6-a955-fbde8895a0fb tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:30.368139 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-e67ac96f-220d-4cc6-a955-fbde8895a0fb tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:30.381639 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-e67ac96f-220d-4cc6-a955-fbde8895a0fb tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 200 len: 1519 microversion: 2.1 time: 0.170038 May 23 15:42:30.391177 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 83/153] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:30 2022] GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 1519 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:42:31.398372 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-02ce572d-f19e-46c2-a148-257f10b17a42 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:31.398983 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-02ce572d-f19e-46c2-a148-257f10b17a42 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:31.406069 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-02ce572d-f19e-46c2-a148-257f10b17a42 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:31.406524 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-02ce572d-f19e-46c2-a148-257f10b17a42 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:31.407295 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-02ce572d-f19e-46c2-a148-257f10b17a42 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:31.407739 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-02ce572d-f19e-46c2-a148-257f10b17a42 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:31.608457 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-02ce572d-f19e-46c2-a148-257f10b17a42 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:31.620973 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-02ce572d-f19e-46c2-a148-257f10b17a42 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 200 len: 1519 microversion: 2.1 time: 0.226319 May 23 15:42:31.621823 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 84/154] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:31 2022] GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 1519 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:42:32.640841 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-d73cc226-ad4e-4800-8709-7020a8864f87 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:32.641626 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-d73cc226-ad4e-4800-8709-7020a8864f87 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:32.649719 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-d73cc226-ad4e-4800-8709-7020a8864f87 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:32.655645 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-d73cc226-ad4e-4800-8709-7020a8864f87 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:32.655645 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-d73cc226-ad4e-4800-8709-7020a8864f87 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:32.655645 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-d73cc226-ad4e-4800-8709-7020a8864f87 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:32.802486 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-d73cc226-ad4e-4800-8709-7020a8864f87 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:32.812751 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-d73cc226-ad4e-4800-8709-7020a8864f87 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 200 len: 1519 microversion: 2.1 time: 0.175521 May 23 15:42:32.812751 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 85/155] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:32 2022] GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 1519 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:42:33.832433 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-f292c333-092a-421c-89f7-cdb0d16d4772 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:33.833257 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-f292c333-092a-421c-89f7-cdb0d16d4772 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:33.849563 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-f292c333-092a-421c-89f7-cdb0d16d4772 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:33.849563 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-f292c333-092a-421c-89f7-cdb0d16d4772 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:33.849563 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-f292c333-092a-421c-89f7-cdb0d16d4772 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:33.849563 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-f292c333-092a-421c-89f7-cdb0d16d4772 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:34.237007 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-49737cd4-ec08-4a9d-82f8-793200aaf9d0 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] 10.222.0.64 "POST /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 7.753899 May 23 15:42:34.247237 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 71/156] 10.222.0.64 () {60 vars in 1322 bytes} [Mon May 23 15:42:26 2022] POST /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41/os-volume_attachments => generated 194 bytes in 7756 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:42:34.322821 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-f292c333-092a-421c-89f7-cdb0d16d4772 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:34.333797 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-f292c333-092a-421c-89f7-cdb0d16d4772 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 200 len: 1519 microversion: 2.1 time: 0.509114 May 23 15:42:34.335622 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 86/157] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:33 2022] GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 1519 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:42:35.352471 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-8733619e-89b9-4936-8e14-e176e6a5285b tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:35.353196 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-8733619e-89b9-4936-8e14-e176e6a5285b tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:35.360057 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-8733619e-89b9-4936-8e14-e176e6a5285b tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:35.360496 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-8733619e-89b9-4936-8e14-e176e6a5285b tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:35.361294 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-8733619e-89b9-4936-8e14-e176e6a5285b tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:35.361726 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-8733619e-89b9-4936-8e14-e176e6a5285b tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:35.515062 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-8733619e-89b9-4936-8e14-e176e6a5285b tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:35.522835 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-8733619e-89b9-4936-8e14-e176e6a5285b tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 200 len: 1519 microversion: 2.1 time: 0.174870 May 23 15:42:35.523405 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 72/158] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:35 2022] GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 1519 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:36.540435 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-57056c06-3608-457c-b24e-083feb34030c tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:36.541069 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-57056c06-3608-457c-b24e-083feb34030c tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:36.548085 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-57056c06-3608-457c-b24e-083feb34030c tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:36.548543 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-57056c06-3608-457c-b24e-083feb34030c tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:36.550851 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-57056c06-3608-457c-b24e-083feb34030c tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:36.550851 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-57056c06-3608-457c-b24e-083feb34030c tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:36.682029 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-57056c06-3608-457c-b24e-083feb34030c tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:36.690053 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-57056c06-3608-457c-b24e-083feb34030c tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 200 len: 1519 microversion: 2.1 time: 0.153439 May 23 15:42:36.700364 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 87/159] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:36 2022] GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:37.708469 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-dce10432-5e5a-4798-81de-25d264dd7c48 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:37.709198 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-dce10432-5e5a-4798-81de-25d264dd7c48 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:37.711811 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_api:SELECT=66 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:42:37.716703 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-dce10432-5e5a-4798-81de-25d264dd7c48 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:37.717354 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-dce10432-5e5a-4798-81de-25d264dd7c48 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:37.718146 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-dce10432-5e5a-4798-81de-25d264dd7c48 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:37.718798 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-dce10432-5e5a-4798-81de-25d264dd7c48 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:37.855328 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-dce10432-5e5a-4798-81de-25d264dd7c48 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:37.871164 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-dce10432-5e5a-4798-81de-25d264dd7c48 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 200 len: 1519 microversion: 2.1 time: 0.158973 May 23 15:42:37.871738 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 73/160] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:37 2022] GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:38.892400 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-16a49b4e-f9fa-4bd2-b632-e97d521c75bc tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:38.893032 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-16a49b4e-f9fa-4bd2-b632-e97d521c75bc tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:38.895313 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_api:SELECT=88 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:42:38.900310 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-16a49b4e-f9fa-4bd2-b632-e97d521c75bc tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:38.900794 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-16a49b4e-f9fa-4bd2-b632-e97d521c75bc tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:38.911450 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-16a49b4e-f9fa-4bd2-b632-e97d521c75bc tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:38.911450 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-16a49b4e-f9fa-4bd2-b632-e97d521c75bc tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:39.084269 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-16a49b4e-f9fa-4bd2-b632-e97d521c75bc tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:39.092963 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-16a49b4e-f9fa-4bd2-b632-e97d521c75bc tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 200 len: 1519 microversion: 2.1 time: 0.206965 May 23 15:42:39.102567 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 88/161] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:38 2022] GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 1519 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:40.110991 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-1e4fda98-cd70-4fa1-8c27-61f314a3ad9f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:40.111573 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-1e4fda98-cd70-4fa1-8c27-61f314a3ad9f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:40.118089 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1e4fda98-cd70-4fa1-8c27-61f314a3ad9f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:40.134929 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1e4fda98-cd70-4fa1-8c27-61f314a3ad9f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:40.134929 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1e4fda98-cd70-4fa1-8c27-61f314a3ad9f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:40.134929 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1e4fda98-cd70-4fa1-8c27-61f314a3ad9f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:40.275902 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-1e4fda98-cd70-4fa1-8c27-61f314a3ad9f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:40.307323 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-1e4fda98-cd70-4fa1-8c27-61f314a3ad9f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 200 len: 1519 microversion: 2.1 time: 0.200965 May 23 15:42:40.307914 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 74/162] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:40 2022] GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 1519 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:41.326156 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-d3a9d9c4-ed7d-4630-8b79-754cd11a94c2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:41.326920 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-d3a9d9c4-ed7d-4630-8b79-754cd11a94c2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:41.333910 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-d3a9d9c4-ed7d-4630-8b79-754cd11a94c2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:41.334452 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-d3a9d9c4-ed7d-4630-8b79-754cd11a94c2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:41.335289 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-d3a9d9c4-ed7d-4630-8b79-754cd11a94c2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:41.336086 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-d3a9d9c4-ed7d-4630-8b79-754cd11a94c2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:41.560940 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-d3a9d9c4-ed7d-4630-8b79-754cd11a94c2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:41.569273 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-d3a9d9c4-ed7d-4630-8b79-754cd11a94c2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 200 len: 1519 microversion: 2.1 time: 0.247893 May 23 15:42:41.571185 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 89/163] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:41 2022] GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 1519 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:42.588854 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-df1977d1-ce28-458e-b1f2-e0b181b4d0f3 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:42.588854 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-df1977d1-ce28-458e-b1f2-e0b181b4d0f3 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:42.594676 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-df1977d1-ce28-458e-b1f2-e0b181b4d0f3 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:42.595225 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-df1977d1-ce28-458e-b1f2-e0b181b4d0f3 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:42.596079 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-df1977d1-ce28-458e-b1f2-e0b181b4d0f3 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:42.596514 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-df1977d1-ce28-458e-b1f2-e0b181b4d0f3 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:42.756905 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-df1977d1-ce28-458e-b1f2-e0b181b4d0f3 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:42.765195 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-df1977d1-ce28-458e-b1f2-e0b181b4d0f3 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 200 len: 1519 microversion: 2.1 time: 0.182250 May 23 15:42:42.766121 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 75/164] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:42 2022] GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 1519 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:43.787360 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-7ff266c6-aaec-432c-bdb2-43d1ec099495 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:43.787360 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-7ff266c6-aaec-432c-bdb2-43d1ec099495 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:43.790827 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-7ff266c6-aaec-432c-bdb2-43d1ec099495 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:43.791283 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-7ff266c6-aaec-432c-bdb2-43d1ec099495 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:43.792107 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-7ff266c6-aaec-432c-bdb2-43d1ec099495 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:43.792714 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-7ff266c6-aaec-432c-bdb2-43d1ec099495 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:43.955498 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-7ff266c6-aaec-432c-bdb2-43d1ec099495 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:43.965372 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-7ff266c6-aaec-432c-bdb2-43d1ec099495 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 200 len: 1519 microversion: 2.1 time: 0.186671 May 23 15:42:43.966391 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 90/165] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:43 2022] GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 1519 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:44.538803 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-b7ff0ff8-bbe4-4dc5-8b69-dda9335f3b37 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:44.539356 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-b7ff0ff8-bbe4-4dc5-8b69-dda9335f3b37 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] [instance: e30f4234-a3e5-4cf3-8d65-583de8fbca41] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:44.546630 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b7ff0ff8-bbe4-4dc5-8b69-dda9335f3b37 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:44.547116 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b7ff0ff8-bbe4-4dc5-8b69-dda9335f3b37 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:44.549094 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b7ff0ff8-bbe4-4dc5-8b69-dda9335f3b37 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:44.549538 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b7ff0ff8-bbe4-4dc5-8b69-dda9335f3b37 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:44.576147 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-b7ff0ff8-bbe4-4dc5-8b69-dda9335f3b37 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] [instance: e30f4234-a3e5-4cf3-8d65-583de8fbca41] Going to try to terminate instance {{(pid=124933) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 15:42:44.968676 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-b7ff0ff8-bbe4-4dc5-8b69-dda9335f3b37 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] 10.222.0.64 "DELETE /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41" status: 204 len: 0 microversion: 2.1 time: 0.433420 May 23 15:42:44.969991 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 76/166] 10.222.0.64 () {58 vars in 1238 bytes} [Mon May 23 15:42:44 2022] DELETE /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 15:42:44.980093 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-43064420-606c-4afc-ab3c-6ddbacfb0d7d tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:44.980872 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-43064420-606c-4afc-ab3c-6ddbacfb0d7d tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] [instance: e30f4234-a3e5-4cf3-8d65-583de8fbca41] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:44.983716 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-328672fd-8f1e-4cfd-8f50-a066e9e42893 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:44.984504 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-328672fd-8f1e-4cfd-8f50-a066e9e42893 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:44.988365 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-43064420-606c-4afc-ab3c-6ddbacfb0d7d tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:44.988822 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-43064420-606c-4afc-ab3c-6ddbacfb0d7d tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:44.989659 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-43064420-606c-4afc-ab3c-6ddbacfb0d7d tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:44.990106 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-43064420-606c-4afc-ab3c-6ddbacfb0d7d tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:44.991563 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-328672fd-8f1e-4cfd-8f50-a066e9e42893 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:44.992083 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-328672fd-8f1e-4cfd-8f50-a066e9e42893 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:44.992955 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-328672fd-8f1e-4cfd-8f50-a066e9e42893 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:44.993502 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-328672fd-8f1e-4cfd-8f50-a066e9e42893 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:45.207692 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-43064420-606c-4afc-ab3c-6ddbacfb0d7d tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916c7e4c45a94167ba39db8c7fec0d19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a819820263647f784079581c7527921', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:45.215279 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-328672fd-8f1e-4cfd-8f50-a066e9e42893 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:45.215419 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-43064420-606c-4afc-ab3c-6ddbacfb0d7d tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] 10.222.0.64 "GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41" status: 200 len: 1552 microversion: 2.1 time: 0.241224 May 23 15:42:45.226662 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 91/167] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:44 2022] GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41 => generated 1552 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:42:45.226762 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-328672fd-8f1e-4cfd-8f50-a066e9e42893 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 200 len: 1519 microversion: 2.1 time: 0.246323 May 23 15:42:45.227454 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 77/168] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:44 2022] GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 1519 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:46.233622 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-e0ebeb54-8c1b-4189-b01e-d43271e076b8 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:46.234227 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-e0ebeb54-8c1b-4189-b01e-d43271e076b8 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] [instance: e30f4234-a3e5-4cf3-8d65-583de8fbca41] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:46.242228 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e0ebeb54-8c1b-4189-b01e-d43271e076b8 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:46.242676 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e0ebeb54-8c1b-4189-b01e-d43271e076b8 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:46.243439 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e0ebeb54-8c1b-4189-b01e-d43271e076b8 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:46.243872 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e0ebeb54-8c1b-4189-b01e-d43271e076b8 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:46.245324 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-20c35b48-fe0a-4f8c-9875-acd2693c3dbf tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:46.246522 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-20c35b48-fe0a-4f8c-9875-acd2693c3dbf tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:46.253859 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-20c35b48-fe0a-4f8c-9875-acd2693c3dbf tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:46.254310 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-20c35b48-fe0a-4f8c-9875-acd2693c3dbf tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:46.255260 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-20c35b48-fe0a-4f8c-9875-acd2693c3dbf tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:46.255696 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-20c35b48-fe0a-4f8c-9875-acd2693c3dbf tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:46.541645 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-20c35b48-fe0a-4f8c-9875-acd2693c3dbf tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:46.545250 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-e0ebeb54-8c1b-4189-b01e-d43271e076b8 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916c7e4c45a94167ba39db8c7fec0d19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a819820263647f784079581c7527921', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:46.550607 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-20c35b48-fe0a-4f8c-9875-acd2693c3dbf tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 200 len: 1519 microversion: 2.1 time: 0.310694 May 23 15:42:46.551260 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 78/169] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:46 2022] GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 1519 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:46.554506 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-e0ebeb54-8c1b-4189-b01e-d43271e076b8 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] 10.222.0.64 "GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41" status: 200 len: 1552 microversion: 2.1 time: 0.324714 May 23 15:42:46.555069 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 92/170] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:46 2022] GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41 => generated 1552 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:47.568460 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-9a5627c8-8508-4cef-aa2e-d4759df8471a tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:47.569524 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-9a5627c8-8508-4cef-aa2e-d4759df8471a tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:47.570939 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-01cfddf4-3d66-428c-9bda-7f2d65ede6e2 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:47.572042 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-01cfddf4-3d66-428c-9bda-7f2d65ede6e2 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] [instance: e30f4234-a3e5-4cf3-8d65-583de8fbca41] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:47.576159 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-9a5627c8-8508-4cef-aa2e-d4759df8471a tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:47.576612 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-9a5627c8-8508-4cef-aa2e-d4759df8471a tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:47.577425 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-9a5627c8-8508-4cef-aa2e-d4759df8471a tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:47.577865 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-9a5627c8-8508-4cef-aa2e-d4759df8471a tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:47.580489 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-01cfddf4-3d66-428c-9bda-7f2d65ede6e2 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:47.581360 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-01cfddf4-3d66-428c-9bda-7f2d65ede6e2 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:47.582346 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-01cfddf4-3d66-428c-9bda-7f2d65ede6e2 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:47.582992 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-01cfddf4-3d66-428c-9bda-7f2d65ede6e2 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:47.790398 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-9a5627c8-8508-4cef-aa2e-d4759df8471a tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:47.799089 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-9a5627c8-8508-4cef-aa2e-d4759df8471a tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 200 len: 1519 microversion: 2.1 time: 0.234463 May 23 15:42:47.799663 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 79/171] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:47 2022] GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 1519 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:42:47.806846 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-01cfddf4-3d66-428c-9bda-7f2d65ede6e2 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916c7e4c45a94167ba39db8c7fec0d19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a819820263647f784079581c7527921', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:47.816264 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-01cfddf4-3d66-428c-9bda-7f2d65ede6e2 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] 10.222.0.64 "GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41" status: 200 len: 1552 microversion: 2.1 time: 0.249289 May 23 15:42:47.816854 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 93/172] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:47 2022] GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41 => generated 1552 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:48.824423 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-fd91095a-dce0-4ba5-8225-e5ddd8319c4f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:48.826595 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-fd91095a-dce0-4ba5-8225-e5ddd8319c4f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:48.833527 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-87200d41-d79f-4630-99c5-78b5d28758a0 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:48.834143 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-87200d41-d79f-4630-99c5-78b5d28758a0 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] [instance: e30f4234-a3e5-4cf3-8d65-583de8fbca41] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:48.842574 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-fd91095a-dce0-4ba5-8225-e5ddd8319c4f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:48.842806 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-87200d41-d79f-4630-99c5-78b5d28758a0 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:48.843469 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-87200d41-d79f-4630-99c5-78b5d28758a0 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:48.843579 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-fd91095a-dce0-4ba5-8225-e5ddd8319c4f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:48.845472 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-fd91095a-dce0-4ba5-8225-e5ddd8319c4f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:48.846729 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-fd91095a-dce0-4ba5-8225-e5ddd8319c4f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:48.852762 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-87200d41-d79f-4630-99c5-78b5d28758a0 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:48.854102 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-87200d41-d79f-4630-99c5-78b5d28758a0 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:49.079798 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-fd91095a-dce0-4ba5-8225-e5ddd8319c4f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:49.088730 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-fd91095a-dce0-4ba5-8225-e5ddd8319c4f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 200 len: 1519 microversion: 2.1 time: 0.274220 May 23 15:42:49.099268 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 80/173] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:48 2022] GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 1519 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:49.099561 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-87200d41-d79f-4630-99c5-78b5d28758a0 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916c7e4c45a94167ba39db8c7fec0d19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a819820263647f784079581c7527921', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:49.104333 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-87200d41-d79f-4630-99c5-78b5d28758a0 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] 10.222.0.64 "GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41" status: 200 len: 1552 microversion: 2.1 time: 0.274974 May 23 15:42:49.104895 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 94/174] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:48 2022] GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41 => generated 1552 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:42:50.109762 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-260b58a8-4297-494b-96f2-10e0b7012a18 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:50.109762 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-260b58a8-4297-494b-96f2-10e0b7012a18 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:50.123734 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-a1d8d46b-e918-4861-9d28-49e6a62216a6 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:50.124989 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-a1d8d46b-e918-4861-9d28-49e6a62216a6 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] [instance: e30f4234-a3e5-4cf3-8d65-583de8fbca41] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:50.131618 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-260b58a8-4297-494b-96f2-10e0b7012a18 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:50.138690 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-260b58a8-4297-494b-96f2-10e0b7012a18 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:50.138690 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-260b58a8-4297-494b-96f2-10e0b7012a18 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:50.138690 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-260b58a8-4297-494b-96f2-10e0b7012a18 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:50.139494 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-a1d8d46b-e918-4861-9d28-49e6a62216a6 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:50.140116 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-a1d8d46b-e918-4861-9d28-49e6a62216a6 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:50.147087 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-a1d8d46b-e918-4861-9d28-49e6a62216a6 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:50.147959 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-a1d8d46b-e918-4861-9d28-49e6a62216a6 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:50.589507 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-a1d8d46b-e918-4861-9d28-49e6a62216a6 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916c7e4c45a94167ba39db8c7fec0d19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a819820263647f784079581c7527921', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:50.600013 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-260b58a8-4297-494b-96f2-10e0b7012a18 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:50.605339 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_cell1:SELECT=100 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:42:50.615663 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-260b58a8-4297-494b-96f2-10e0b7012a18 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 200 len: 1519 microversion: 2.1 time: 0.512632 May 23 15:42:50.628937 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 81/175] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:50 2022] GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 1519 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:50.629148 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-a1d8d46b-e918-4861-9d28-49e6a62216a6 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] 10.222.0.64 "GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41" status: 200 len: 1552 microversion: 2.1 time: 0.504709 May 23 15:42:50.629148 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 95/176] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:50 2022] GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41 => generated 1552 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:51.154056 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [req-69685526-12f0-4772-841d-f5fbdff46eb6 req-0edd352f-402a-4336-a611-8eb41e5131a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e30f4234-a3e5-4cf3-8d65-583de8fbca41", "name": "network-vif-deleted", "tag": "620fab52-b890-4499-b5f7-e33158b7c317"}]} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:42:51.177262 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-69685526-12f0-4772-841d-f5fbdff46eb6 req-0edd352f-402a-4336-a611-8eb41e5131a0 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:51.186700 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-69685526-12f0-4772-841d-f5fbdff46eb6 req-0edd352f-402a-4336-a611-8eb41e5131a0 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:51.207818 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.compute.server_external_events [req-69685526-12f0-4772-841d-f5fbdff46eb6 req-0edd352f-402a-4336-a611-8eb41e5131a0 service nova] Creating event network-vif-deleted:620fab52-b890-4499-b5f7-e33158b7c317 for instance e30f4234-a3e5-4cf3-8d65-583de8fbca41 on hv-cinder-84067 May 23 15:42:51.213765 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [req-69685526-12f0-4772-841d-f5fbdff46eb6 req-0edd352f-402a-4336-a611-8eb41e5131a0 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063341 May 23 15:42:51.215013 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 82/177] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:42:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:42:51.635603 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-f68941b2-4ad7-408a-80fd-96221e82244d tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:51.636280 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-f68941b2-4ad7-408a-80fd-96221e82244d tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:51.646003 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-f68941b2-4ad7-408a-80fd-96221e82244d tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:51.646478 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-f68941b2-4ad7-408a-80fd-96221e82244d tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:51.647251 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-f68941b2-4ad7-408a-80fd-96221e82244d tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:51.647699 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-f68941b2-4ad7-408a-80fd-96221e82244d tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:51.648913 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-2f3d7e13-8f05-4e3a-b94d-3c4224a14a9b tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:51.649641 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-2f3d7e13-8f05-4e3a-b94d-3c4224a14a9b tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] [instance: e30f4234-a3e5-4cf3-8d65-583de8fbca41] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:51.665445 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-2f3d7e13-8f05-4e3a-b94d-3c4224a14a9b tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:51.666319 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-2f3d7e13-8f05-4e3a-b94d-3c4224a14a9b tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:51.667128 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-2f3d7e13-8f05-4e3a-b94d-3c4224a14a9b tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:51.669727 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-2f3d7e13-8f05-4e3a-b94d-3c4224a14a9b tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:51.877278 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-2f3d7e13-8f05-4e3a-b94d-3c4224a14a9b tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916c7e4c45a94167ba39db8c7fec0d19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a819820263647f784079581c7527921', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:51.903443 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-2f3d7e13-8f05-4e3a-b94d-3c4224a14a9b tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] 10.222.0.64 "GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41" status: 200 len: 1345 microversion: 2.1 time: 0.257421 May 23 15:42:51.909208 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 83/178] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:51 2022] GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41 => generated 1345 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:42:52.019591 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-f68941b2-4ad7-408a-80fd-96221e82244d tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:52.027846 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-f68941b2-4ad7-408a-80fd-96221e82244d tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 200 len: 1519 microversion: 2.1 time: 0.396920 May 23 15:42:52.030813 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 96/179] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:51 2022] GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 1519 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:52.930572 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-7069ff7f-a085-4156-a71d-e430ae63d0c7 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:52.931195 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-7069ff7f-a085-4156-a71d-e430ae63d0c7 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] [instance: e30f4234-a3e5-4cf3-8d65-583de8fbca41] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:52.941356 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-7069ff7f-a085-4156-a71d-e430ae63d0c7 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:52.942165 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-7069ff7f-a085-4156-a71d-e430ae63d0c7 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:52.943198 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-7069ff7f-a085-4156-a71d-e430ae63d0c7 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:52.943827 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-7069ff7f-a085-4156-a71d-e430ae63d0c7 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:52.988679 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-7069ff7f-a085-4156-a71d-e430ae63d0c7 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:52.989868 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-7069ff7f-a085-4156-a71d-e430ae63d0c7 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:52.989868 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.objects.instance [None req-7069ff7f-a085-4156-a71d-e430ae63d0c7 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lazy-loading 'fault' on Instance uuid e30f4234-a3e5-4cf3-8d65-583de8fbca41 {{(pid=124933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 15:42:53.052772 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-5a3f4676-fc0c-4ec2-a54d-ab2c8602cdf4 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:53.053426 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-5a3f4676-fc0c-4ec2-a54d-ab2c8602cdf4 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:53.064024 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-7069ff7f-a085-4156-a71d-e430ae63d0c7 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '916c7e4c45a94167ba39db8c7fec0d19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a819820263647f784079581c7527921', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:53.065290 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5a3f4676-fc0c-4ec2-a54d-ab2c8602cdf4 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:53.067511 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5a3f4676-fc0c-4ec2-a54d-ab2c8602cdf4 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:53.068677 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5a3f4676-fc0c-4ec2-a54d-ab2c8602cdf4 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:53.071267 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5a3f4676-fc0c-4ec2-a54d-ab2c8602cdf4 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:53.072347 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-7069ff7f-a085-4156-a71d-e430ae63d0c7 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] 10.222.0.64 "GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41" status: 200 len: 1350 microversion: 2.1 time: 0.153375 May 23 15:42:53.072923 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 84/180] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:52 2022] GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41 => generated 1350 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:53.396831 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-5a3f4676-fc0c-4ec2-a54d-ab2c8602cdf4 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:53.409872 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-5a3f4676-fc0c-4ec2-a54d-ab2c8602cdf4 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 200 len: 1519 microversion: 2.1 time: 0.362389 May 23 15:42:53.410459 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 97/181] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:53 2022] GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 1519 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:54.089351 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-a98aed0f-3ee4-478e-aa92-dd4d0b3e0629 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:54.090514 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-a98aed0f-3ee4-478e-aa92-dd4d0b3e0629 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] [instance: e30f4234-a3e5-4cf3-8d65-583de8fbca41] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:54.098273 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a98aed0f-3ee4-478e-aa92-dd4d0b3e0629 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:54.098945 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a98aed0f-3ee4-478e-aa92-dd4d0b3e0629 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:54.099885 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a98aed0f-3ee4-478e-aa92-dd4d0b3e0629 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:54.100483 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a98aed0f-3ee4-478e-aa92-dd4d0b3e0629 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:54.123131 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.wsgi [None req-a98aed0f-3ee4-478e-aa92-dd4d0b3e0629 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] HTTP exception thrown: Instance e30f4234-a3e5-4cf3-8d65-583de8fbca41 could not be found. May 23 15:42:54.130048 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-a98aed0f-3ee4-478e-aa92-dd4d0b3e0629 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Request method failure captured: May 23 15:42:54.130048 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: request: GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41 HTTP/1.1 May 23 15:42:54.130048 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Accept: application/json May 23 15:42:54.130048 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Accept-Encoding: identity May 23 15:42:54.130048 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Connection: close May 23 15:42:54.130048 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Content-Length: 0 May 23 15:42:54.130048 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Content-Type: application/json May 23 15:42:54.130048 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Host: 10.222.0.64 May 23 15:42:54.130048 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Openstack-System-Scope: None May 23 15:42:54.130048 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: User-Agent: python-urllib3/1.26.9 May 23 15:42:54.130048 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Auth-Token: gAAAAABii6suxTDViYS3fnCFsoiyZlEzjKCiMkiMAm842IQ-aXwxU0NLmu34k-UL2lMco4jvja1_pL_W-7Mfv-LXfCrPQqzN34RrxVSgm3o0WZyNUBdmJ2uX7mzGutOyu7KyGH7aVMt5DOhsT9Jn0MDmA6MxYa7A61GwTIrLqo6h9v4CnZPb4sk May 23 15:42:54.130048 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Domain-Id: None May 23 15:42:54.130048 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Domain-Name: None May 23 15:42:54.130048 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Identity-Status: Confirmed May 23 15:42:54.130048 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Is-Admin-Project: True May 23 15:42:54.130048 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Domain-Id: default May 23 15:42:54.130048 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Domain-Name: Default May 23 15:42:54.130048 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Id: 0a819820263647f784079581c7527921 May 23 15:42:54.130048 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Name: tempest-DeleteServersTestJSON-866228921 May 23 15:42:54.130048 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Role: reader,member May 23 15:42:54.130048 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Roles: reader,member May 23 15:42:54.131585 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0a819820263647f784079581c7527921"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/0a819820263647f784079581c7527921"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0a819820263647f784079581c7527921"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_0a819820263647f784079581c7527921", "adminURL": "http://10.222.0.64:8080"}]}] May 23 15:42:54.131585 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant: tempest-DeleteServersTestJSON-866228921 May 23 15:42:54.131585 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant-Id: 0a819820263647f784079581c7527921 May 23 15:42:54.131585 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant-Name: tempest-DeleteServersTestJSON-866228921 May 23 15:42:54.131585 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User: tempest-DeleteServersTestJSON-866228921-project May 23 15:42:54.131585 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Domain-Id: default May 23 15:42:54.131585 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Domain-Name: Default May 23 15:42:54.131585 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Id: 916c7e4c45a94167ba39db8c7fec0d19 May 23 15:42:54.131585 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Name: tempest-DeleteServersTestJSON-866228921-project May 23 15:42:54.131585 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: method: > May 23 15:42:54.131585 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: exception: Instance e30f4234-a3e5-4cf3-8d65-583de8fbca41 could not be found. May 23 15:42:54.131585 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: action_args: {'id': 'e30f4234-a3e5-4cf3-8d65-583de8fbca41'} May 23 15:42:54.132441 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:42:54.132441 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:42:54.132441 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:42:54.132441 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:42:54.132441 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:42:54.132441 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:42:54.132441 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:42:54.132441 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:42:54.132441 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:42:54.132441 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:42:54.132441 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e30f4234-a3e5-4cf3-8d65-583de8fbca41 could not be found. May 23 15:42:54.132441 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:42:54.132441 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:42:54.132441 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:42:54.132441 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:42:54.132441 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:42:54.132441 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:42:54.132441 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:42:54.132441 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:42:54.132441 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:42:54.151958 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:42:54.151958 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 15:42:54.151958 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 15:42:54.151958 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:42:54.151958 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:42:54.151958 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:42:54.151958 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:42:54.151958 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e30f4234-a3e5-4cf3-8d65-583de8fbca41 could not be found. May 23 15:42:54.151958 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:42:54.151958 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:42:54.151958 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:42:54.151958 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:42:54.151958 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:42:54.151958 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:42:54.151958 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:42:54.151958 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:42:54.151958 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e30f4234-a3e5-4cf3-8d65-583de8fbca41 could not be found. May 23 15:42:54.151958 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:42:54.153468 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-a98aed0f-3ee4-478e-aa92-dd4d0b3e0629 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Returning 404 to user: Instance e30f4234-a3e5-4cf3-8d65-583de8fbca41 could not be found. {{(pid=124933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:42:54.153468 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-a98aed0f-3ee4-478e-aa92-dd4d0b3e0629 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] 10.222.0.64 "GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41" status: 404 len: 111 microversion: 2.1 time: 0.045868 May 23 15:42:54.153468 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 85/182] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:54 2022] GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 15:42:54.248386 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-2c496748-e5fd-4af0-84e2-ccf9cd8701d5 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:54.249340 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-2c496748-e5fd-4af0-84e2-ccf9cd8701d5 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] [instance: e30f4234-a3e5-4cf3-8d65-583de8fbca41] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:54.256640 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2c496748-e5fd-4af0-84e2-ccf9cd8701d5 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:54.257141 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2c496748-e5fd-4af0-84e2-ccf9cd8701d5 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:54.257930 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2c496748-e5fd-4af0-84e2-ccf9cd8701d5 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:54.258374 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2c496748-e5fd-4af0-84e2-ccf9cd8701d5 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:54.272830 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.wsgi [None req-2c496748-e5fd-4af0-84e2-ccf9cd8701d5 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] HTTP exception thrown: Instance e30f4234-a3e5-4cf3-8d65-583de8fbca41 could not be found. May 23 15:42:54.277226 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-2c496748-e5fd-4af0-84e2-ccf9cd8701d5 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Request method failure captured: May 23 15:42:54.277226 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: request: GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41/os-volume_attachments HTTP/1.1 May 23 15:42:54.277226 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Accept: application/json May 23 15:42:54.277226 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Accept-Encoding: identity May 23 15:42:54.277226 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Connection: close May 23 15:42:54.277226 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Content-Length: 0 May 23 15:42:54.277226 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Content-Type: application/json May 23 15:42:54.277226 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Host: 10.222.0.64 May 23 15:42:54.277226 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Openstack-System-Scope: None May 23 15:42:54.277226 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: User-Agent: python-urllib3/1.26.9 May 23 15:42:54.277226 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Auth-Token: gAAAAABii6suxTDViYS3fnCFsoiyZlEzjKCiMkiMAm842IQ-aXwxU0NLmu34k-UL2lMco4jvja1_pL_W-7Mfv-LXfCrPQqzN34RrxVSgm3o0WZyNUBdmJ2uX7mzGutOyu7KyGH7aVMt5DOhsT9Jn0MDmA6MxYa7A61GwTIrLqo6h9v4CnZPb4sk May 23 15:42:54.277226 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Domain-Id: None May 23 15:42:54.277226 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Domain-Name: None May 23 15:42:54.277226 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Identity-Status: Confirmed May 23 15:42:54.277226 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Is-Admin-Project: True May 23 15:42:54.277226 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Domain-Id: default May 23 15:42:54.277226 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Domain-Name: Default May 23 15:42:54.277226 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Id: 0a819820263647f784079581c7527921 May 23 15:42:54.277226 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Name: tempest-DeleteServersTestJSON-866228921 May 23 15:42:54.277226 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Role: reader,member May 23 15:42:54.277226 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Roles: reader,member May 23 15:42:54.304181 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0a819820263647f784079581c7527921"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/0a819820263647f784079581c7527921"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0a819820263647f784079581c7527921"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_0a819820263647f784079581c7527921", "adminURL": "http://10.222.0.64:8080"}]}] May 23 15:42:54.304181 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant: tempest-DeleteServersTestJSON-866228921 May 23 15:42:54.304181 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant-Id: 0a819820263647f784079581c7527921 May 23 15:42:54.304181 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant-Name: tempest-DeleteServersTestJSON-866228921 May 23 15:42:54.304181 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User: tempest-DeleteServersTestJSON-866228921-project May 23 15:42:54.304181 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Domain-Id: default May 23 15:42:54.304181 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Domain-Name: Default May 23 15:42:54.304181 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Id: 916c7e4c45a94167ba39db8c7fec0d19 May 23 15:42:54.304181 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Name: tempest-DeleteServersTestJSON-866228921-project May 23 15:42:54.304181 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: method: > May 23 15:42:54.304181 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: exception: Instance e30f4234-a3e5-4cf3-8d65-583de8fbca41 could not be found. May 23 15:42:54.304181 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: action_args: {'server_id': 'e30f4234-a3e5-4cf3-8d65-583de8fbca41'} May 23 15:42:54.305653 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:42:54.305653 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:42:54.305653 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:42:54.305653 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:42:54.305653 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:42:54.305653 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:42:54.305653 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:42:54.305653 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:42:54.305653 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:42:54.305653 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:42:54.305653 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e30f4234-a3e5-4cf3-8d65-583de8fbca41 could not be found. May 23 15:42:54.305653 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:42:54.305653 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:42:54.305653 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:42:54.305653 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:42:54.305653 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:42:54.305653 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:42:54.305653 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:42:54.305653 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:42:54.305653 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:42:54.307292 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:42:54.307292 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 23 15:42:54.307292 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 15:42:54.307292 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 23 15:42:54.307292 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 15:42:54.307292 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 23 15:42:54.307292 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 23 15:42:54.307292 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:42:54.307292 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:42:54.307292 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e30f4234-a3e5-4cf3-8d65-583de8fbca41 could not be found. May 23 15:42:54.307292 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:42:54.307292 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:42:54.307292 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:42:54.307292 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:42:54.307292 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:42:54.307292 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:42:54.307292 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:42:54.307292 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:42:54.307292 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e30f4234-a3e5-4cf3-8d65-583de8fbca41 could not be found. May 23 15:42:54.307292 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:42:54.309034 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-2c496748-e5fd-4af0-84e2-ccf9cd8701d5 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Returning 404 to user: Instance e30f4234-a3e5-4cf3-8d65-583de8fbca41 could not be found. {{(pid=124934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:42:54.309034 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-2c496748-e5fd-4af0-84e2-ccf9cd8701d5 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] 10.222.0.64 "GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034349 May 23 15:42:54.309034 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 98/183] 10.222.0.64 () {58 vars in 1301 bytes} [Mon May 23 15:42:54 2022] GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 15:42:54.428119 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-22801a8e-553d-4084-b5b9-81a7a47d39ef tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:54.428880 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-22801a8e-553d-4084-b5b9-81a7a47d39ef tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:54.437364 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-22801a8e-553d-4084-b5b9-81a7a47d39ef tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:54.438201 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-22801a8e-553d-4084-b5b9-81a7a47d39ef tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:54.440246 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-22801a8e-553d-4084-b5b9-81a7a47d39ef tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:54.440874 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-22801a8e-553d-4084-b5b9-81a7a47d39ef tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:54.461327 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:42:54.895617 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-22801a8e-553d-4084-b5b9-81a7a47d39ef tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:54.902913 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-22801a8e-553d-4084-b5b9-81a7a47d39ef tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 200 len: 1519 microversion: 2.1 time: 0.480017 May 23 15:42:54.909128 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 86/184] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:54 2022] GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 1519 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:55.836653 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-8c336c27-a9bd-4f43-84d7-16502ecd2d79 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:55.837757 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-8c336c27-a9bd-4f43-84d7-16502ecd2d79 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] [instance: e30f4234-a3e5-4cf3-8d65-583de8fbca41] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:55.846512 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-8c336c27-a9bd-4f43-84d7-16502ecd2d79 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:55.847209 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-8c336c27-a9bd-4f43-84d7-16502ecd2d79 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:55.848636 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-8c336c27-a9bd-4f43-84d7-16502ecd2d79 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:55.849350 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-8c336c27-a9bd-4f43-84d7-16502ecd2d79 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:55.867471 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.wsgi [None req-8c336c27-a9bd-4f43-84d7-16502ecd2d79 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] HTTP exception thrown: Instance e30f4234-a3e5-4cf3-8d65-583de8fbca41 could not be found. May 23 15:42:55.870225 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-8c336c27-a9bd-4f43-84d7-16502ecd2d79 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Request method failure captured: May 23 15:42:55.870225 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: request: DELETE /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41 HTTP/1.1 May 23 15:42:55.870225 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Accept: application/json May 23 15:42:55.870225 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Accept-Encoding: identity May 23 15:42:55.870225 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Connection: close May 23 15:42:55.870225 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Content-Length: 0 May 23 15:42:55.870225 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Content-Type: application/json May 23 15:42:55.870225 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Host: 10.222.0.64 May 23 15:42:55.870225 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Openstack-System-Scope: None May 23 15:42:55.870225 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: User-Agent: python-urllib3/1.26.9 May 23 15:42:55.870225 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Auth-Token: gAAAAABii6suxTDViYS3fnCFsoiyZlEzjKCiMkiMAm842IQ-aXwxU0NLmu34k-UL2lMco4jvja1_pL_W-7Mfv-LXfCrPQqzN34RrxVSgm3o0WZyNUBdmJ2uX7mzGutOyu7KyGH7aVMt5DOhsT9Jn0MDmA6MxYa7A61GwTIrLqo6h9v4CnZPb4sk May 23 15:42:55.870225 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Domain-Id: None May 23 15:42:55.870225 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Domain-Name: None May 23 15:42:55.870225 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Identity-Status: Confirmed May 23 15:42:55.870225 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Is-Admin-Project: True May 23 15:42:55.870225 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Domain-Id: default May 23 15:42:55.870225 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Domain-Name: Default May 23 15:42:55.870225 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Id: 0a819820263647f784079581c7527921 May 23 15:42:55.870225 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Name: tempest-DeleteServersTestJSON-866228921 May 23 15:42:55.870225 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Role: reader,member May 23 15:42:55.870225 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Roles: reader,member May 23 15:42:55.871527 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0a819820263647f784079581c7527921"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/0a819820263647f784079581c7527921"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0a819820263647f784079581c7527921"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_0a819820263647f784079581c7527921", "adminURL": "http://10.222.0.64:8080"}]}] May 23 15:42:55.871527 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant: tempest-DeleteServersTestJSON-866228921 May 23 15:42:55.871527 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant-Id: 0a819820263647f784079581c7527921 May 23 15:42:55.871527 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant-Name: tempest-DeleteServersTestJSON-866228921 May 23 15:42:55.871527 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User: tempest-DeleteServersTestJSON-866228921-project May 23 15:42:55.871527 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Domain-Id: default May 23 15:42:55.871527 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Domain-Name: Default May 23 15:42:55.871527 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Id: 916c7e4c45a94167ba39db8c7fec0d19 May 23 15:42:55.871527 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Name: tempest-DeleteServersTestJSON-866228921-project May 23 15:42:55.871527 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: method: > May 23 15:42:55.871527 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: exception: Instance e30f4234-a3e5-4cf3-8d65-583de8fbca41 could not be found. May 23 15:42:55.871527 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: action_args: {'id': 'e30f4234-a3e5-4cf3-8d65-583de8fbca41'} May 23 15:42:55.872230 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:42:55.872230 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:42:55.872230 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:42:55.872230 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:42:55.872230 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:42:55.872230 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:42:55.872230 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:42:55.872230 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:42:55.872230 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:42:55.872230 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:42:55.872230 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e30f4234-a3e5-4cf3-8d65-583de8fbca41 could not be found. May 23 15:42:55.872230 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:42:55.872230 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:42:55.872230 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:42:55.872230 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:42:55.872230 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:42:55.872230 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:42:55.872230 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:42:55.872230 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:42:55.872230 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:42:55.873357 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:42:55.873357 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 15:42:55.873357 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 15:42:55.873357 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 15:42:55.873357 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 15:42:55.873357 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:42:55.873357 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:42:55.873357 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:42:55.873357 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:42:55.873357 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e30f4234-a3e5-4cf3-8d65-583de8fbca41 could not be found. May 23 15:42:55.873357 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:42:55.873357 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:42:55.873357 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:42:55.873357 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:42:55.873357 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:42:55.873357 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:42:55.873357 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:42:55.873357 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:42:55.873357 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e30f4234-a3e5-4cf3-8d65-583de8fbca41 could not be found. May 23 15:42:55.873357 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:42:55.875288 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-8c336c27-a9bd-4f43-84d7-16502ecd2d79 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Returning 404 to user: Instance e30f4234-a3e5-4cf3-8d65-583de8fbca41 could not be found. {{(pid=124934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:42:55.875882 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-8c336c27-a9bd-4f43-84d7-16502ecd2d79 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] 10.222.0.64 "DELETE /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41" status: 404 len: 111 microversion: 2.1 time: 0.044574 May 23 15:42:55.879375 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 99/185] 10.222.0.64 () {58 vars in 1238 bytes} [Mon May 23 15:42:55 2022] DELETE /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 15:42:55.890186 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-4cb08616-f3ac-4680-b477-44b98b5c84f3 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:55.890186 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-4cb08616-f3ac-4680-b477-44b98b5c84f3 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] [instance: e30f4234-a3e5-4cf3-8d65-583de8fbca41] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:55.898455 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-4cb08616-f3ac-4680-b477-44b98b5c84f3 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:55.898972 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-4cb08616-f3ac-4680-b477-44b98b5c84f3 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:55.899817 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-4cb08616-f3ac-4680-b477-44b98b5c84f3 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:55.900595 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-4cb08616-f3ac-4680-b477-44b98b5c84f3 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:55.921836 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-883e27ac-1edb-4f72-8bed-26fb714ddcdf tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:55.923282 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-883e27ac-1edb-4f72-8bed-26fb714ddcdf tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:55.933760 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-883e27ac-1edb-4f72-8bed-26fb714ddcdf tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:55.934497 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-883e27ac-1edb-4f72-8bed-26fb714ddcdf tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:55.935870 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-883e27ac-1edb-4f72-8bed-26fb714ddcdf tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:55.937273 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-883e27ac-1edb-4f72-8bed-26fb714ddcdf tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:55.938165 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.wsgi [None req-4cb08616-f3ac-4680-b477-44b98b5c84f3 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] HTTP exception thrown: Instance e30f4234-a3e5-4cf3-8d65-583de8fbca41 could not be found. May 23 15:42:55.942532 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-4cb08616-f3ac-4680-b477-44b98b5c84f3 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Request method failure captured: May 23 15:42:55.942532 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: request: GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41 HTTP/1.1 May 23 15:42:55.942532 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Accept: application/json May 23 15:42:55.942532 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Accept-Encoding: identity May 23 15:42:55.942532 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Connection: close May 23 15:42:55.942532 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Content-Length: 0 May 23 15:42:55.942532 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Content-Type: application/json May 23 15:42:55.942532 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Host: 10.222.0.64 May 23 15:42:55.942532 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Openstack-System-Scope: None May 23 15:42:55.942532 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: User-Agent: python-urllib3/1.26.9 May 23 15:42:55.942532 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Auth-Token: gAAAAABii6suxTDViYS3fnCFsoiyZlEzjKCiMkiMAm842IQ-aXwxU0NLmu34k-UL2lMco4jvja1_pL_W-7Mfv-LXfCrPQqzN34RrxVSgm3o0WZyNUBdmJ2uX7mzGutOyu7KyGH7aVMt5DOhsT9Jn0MDmA6MxYa7A61GwTIrLqo6h9v4CnZPb4sk May 23 15:42:55.942532 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Domain-Id: None May 23 15:42:55.942532 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Domain-Name: None May 23 15:42:55.942532 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Identity-Status: Confirmed May 23 15:42:55.942532 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Is-Admin-Project: True May 23 15:42:55.942532 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Domain-Id: default May 23 15:42:55.942532 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Domain-Name: Default May 23 15:42:55.942532 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Id: 0a819820263647f784079581c7527921 May 23 15:42:55.942532 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Name: tempest-DeleteServersTestJSON-866228921 May 23 15:42:55.942532 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Role: reader,member May 23 15:42:55.942532 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Roles: reader,member May 23 15:42:55.946858 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0a819820263647f784079581c7527921"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/0a819820263647f784079581c7527921"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0a819820263647f784079581c7527921"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_0a819820263647f784079581c7527921", "adminURL": "http://10.222.0.64:8080"}]}] May 23 15:42:55.946858 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant: tempest-DeleteServersTestJSON-866228921 May 23 15:42:55.946858 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant-Id: 0a819820263647f784079581c7527921 May 23 15:42:55.946858 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant-Name: tempest-DeleteServersTestJSON-866228921 May 23 15:42:55.946858 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User: tempest-DeleteServersTestJSON-866228921-project May 23 15:42:55.946858 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Domain-Id: default May 23 15:42:55.946858 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Domain-Name: Default May 23 15:42:55.946858 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Id: 916c7e4c45a94167ba39db8c7fec0d19 May 23 15:42:55.946858 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Name: tempest-DeleteServersTestJSON-866228921-project May 23 15:42:55.946858 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: method: > May 23 15:42:55.946858 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: exception: Instance e30f4234-a3e5-4cf3-8d65-583de8fbca41 could not be found. May 23 15:42:55.946858 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: action_args: {'id': 'e30f4234-a3e5-4cf3-8d65-583de8fbca41'} May 23 15:42:55.947528 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:42:55.947528 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:42:55.947528 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:42:55.947528 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:42:55.947528 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:42:55.947528 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:42:55.947528 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:42:55.947528 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:42:55.947528 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:42:55.947528 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:42:55.947528 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e30f4234-a3e5-4cf3-8d65-583de8fbca41 could not be found. May 23 15:42:55.947528 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:42:55.947528 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:42:55.947528 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:42:55.947528 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:42:55.947528 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:42:55.947528 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:42:55.947528 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:42:55.947528 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:42:55.947528 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:42:55.948566 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:42:55.948566 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 15:42:55.948566 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 15:42:55.948566 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:42:55.948566 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:42:55.948566 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:42:55.948566 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:42:55.948566 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e30f4234-a3e5-4cf3-8d65-583de8fbca41 could not be found. May 23 15:42:55.948566 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:42:55.948566 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:42:55.948566 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:42:55.948566 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:42:55.948566 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:42:55.948566 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:42:55.948566 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:42:55.948566 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:42:55.948566 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e30f4234-a3e5-4cf3-8d65-583de8fbca41 could not be found. May 23 15:42:55.948566 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:42:55.950276 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-4cb08616-f3ac-4680-b477-44b98b5c84f3 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] Returning 404 to user: Instance e30f4234-a3e5-4cf3-8d65-583de8fbca41 could not be found. {{(pid=124933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:42:55.950276 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-4cb08616-f3ac-4680-b477-44b98b5c84f3 tempest-DeleteServersTestJSON-866228921 tempest-DeleteServersTestJSON-866228921-project] 10.222.0.64 "GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41" status: 404 len: 111 microversion: 2.1 time: 0.062555 May 23 15:42:55.950276 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 87/186] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:55 2022] GET /compute/v2.1/servers/e30f4234-a3e5-4cf3-8d65-583de8fbca41 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 23 15:42:56.300667 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-883e27ac-1edb-4f72-8bed-26fb714ddcdf tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:56.312130 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-883e27ac-1edb-4f72-8bed-26fb714ddcdf tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 200 len: 1519 microversion: 2.1 time: 0.395617 May 23 15:42:56.313564 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 100/187] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:55 2022] GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 1519 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:57.331494 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-0de1eb42-5bfc-4c29-b36d-ec32f8731e08 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:57.337697 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-0de1eb42-5bfc-4c29-b36d-ec32f8731e08 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:57.345969 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-0de1eb42-5bfc-4c29-b36d-ec32f8731e08 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:57.346423 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-0de1eb42-5bfc-4c29-b36d-ec32f8731e08 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:57.347857 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-0de1eb42-5bfc-4c29-b36d-ec32f8731e08 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:57.350526 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-0de1eb42-5bfc-4c29-b36d-ec32f8731e08 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:57.681887 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-0de1eb42-5bfc-4c29-b36d-ec32f8731e08 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:57.699720 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-0de1eb42-5bfc-4c29-b36d-ec32f8731e08 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 200 len: 1519 microversion: 2.1 time: 0.373752 May 23 15:42:57.700907 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 88/188] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:57 2022] GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 1519 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:42:58.727838 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-e9afee27-a42f-4945-b501-81c72165a29f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:42:58.730565 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-e9afee27-a42f-4945-b501-81c72165a29f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:42:58.760417 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e9afee27-a42f-4945-b501-81c72165a29f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:58.760945 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e9afee27-a42f-4945-b501-81c72165a29f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:58.763896 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e9afee27-a42f-4945-b501-81c72165a29f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:42:58.764341 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e9afee27-a42f-4945-b501-81c72165a29f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:42:59.114138 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-e9afee27-a42f-4945-b501-81c72165a29f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:42:59.153507 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-e9afee27-a42f-4945-b501-81c72165a29f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 200 len: 1519 microversion: 2.1 time: 0.430153 May 23 15:42:59.154298 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 101/189] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:42:58 2022] GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 1519 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:00.173038 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-6d33962a-d635-46c8-afc8-b835082ce73e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:00.174988 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-6d33962a-d635-46c8-afc8-b835082ce73e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:00.193274 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-6d33962a-d635-46c8-afc8-b835082ce73e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:00.193718 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-6d33962a-d635-46c8-afc8-b835082ce73e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:00.196195 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-6d33962a-d635-46c8-afc8-b835082ce73e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:00.196638 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-6d33962a-d635-46c8-afc8-b835082ce73e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:00.636559 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-6d33962a-d635-46c8-afc8-b835082ce73e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:00.646179 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-6d33962a-d635-46c8-afc8-b835082ce73e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 200 len: 1519 microversion: 2.1 time: 0.478774 May 23 15:43:00.647318 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 89/190] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:00 2022] GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 1519 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:01.664405 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-aa41b1a3-72e0-4e00-b4cd-1933aae26d2a tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:01.666094 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-aa41b1a3-72e0-4e00-b4cd-1933aae26d2a tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:01.681782 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-aa41b1a3-72e0-4e00-b4cd-1933aae26d2a tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:01.682253 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-aa41b1a3-72e0-4e00-b4cd-1933aae26d2a tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:01.683062 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-aa41b1a3-72e0-4e00-b4cd-1933aae26d2a tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:01.683498 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-aa41b1a3-72e0-4e00-b4cd-1933aae26d2a tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:01.976087 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-aa41b1a3-72e0-4e00-b4cd-1933aae26d2a tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:01.988465 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-aa41b1a3-72e0-4e00-b4cd-1933aae26d2a tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 200 len: 1519 microversion: 2.1 time: 0.325312 May 23 15:43:01.995590 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 102/191] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:01 2022] GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 1519 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:03.008831 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-39e77532-7ac9-4043-b83f-484ab0403407 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:03.010066 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-39e77532-7ac9-4043-b83f-484ab0403407 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:03.027097 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-39e77532-7ac9-4043-b83f-484ab0403407 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:03.036125 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-39e77532-7ac9-4043-b83f-484ab0403407 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:03.036973 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-39e77532-7ac9-4043-b83f-484ab0403407 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:03.038254 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-39e77532-7ac9-4043-b83f-484ab0403407 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:03.405411 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-39e77532-7ac9-4043-b83f-484ab0403407 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:03.418741 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-39e77532-7ac9-4043-b83f-484ab0403407 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 200 len: 1519 microversion: 2.1 time: 0.414312 May 23 15:43:03.420135 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 90/192] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:03 2022] GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 1519 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:03.493388 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-0b6e405d-5233-46de-b927-68cbc2634445 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-145679738", "imageRef": "a5c8503f-3733-426f-8a5b-c7c9358e4a45", "flavorRef": "452", "networks": [{"uuid": "1f7dcd01-712e-4910-801c-ec7cd2120c05"}]}} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:43:03.573904 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.network.neutron [None req-0b6e405d-5233-46de-b927-68cbc2634445 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] validate_networks() for [('1f7dcd01-712e-4910-801c-ec7cd2120c05', None, None, None, None, None)] {{(pid=124934) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 15:43:04.410302 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.virt.hardware [None req-0b6e405d-5233-46de-b927-68cbc2634445 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Flavor limits 0:0:0 {{(pid=124934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 15:43:04.410761 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.virt.hardware [None req-0b6e405d-5233-46de-b927-68cbc2634445 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Image limits 0:0:0 {{(pid=124934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 15:43:04.415012 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.virt.hardware [None req-0b6e405d-5233-46de-b927-68cbc2634445 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Flavor pref 0:0:0 {{(pid=124934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 15:43:04.415547 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.virt.hardware [None req-0b6e405d-5233-46de-b927-68cbc2634445 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Image pref 0:0:0 {{(pid=124934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 15:43:04.415937 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.virt.hardware [None req-0b6e405d-5233-46de-b927-68cbc2634445 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 15:43:04.440706 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0b6e405d-5233-46de-b927-68cbc2634445 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:04.441210 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0b6e405d-5233-46de-b927-68cbc2634445 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:04.442019 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0b6e405d-5233-46de-b927-68cbc2634445 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:04.442463 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0b6e405d-5233-46de-b927-68cbc2634445 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:04.475425 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-e1cf7ae9-b90e-4a34-84ed-5373f24e0baa tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Action: 'create', calling method: .version_select at 0x7fab52843c10>, body: {"keypair": {"name": "tempest-TestShelveInstance-503509047", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHXae0RjlDcsDrkC7Kyepx28zzVtcnBYKgDSz49KRyunl2Vk5ZaE0BhJM0SOzDwKRy05hgYHcESo5O5rMvdHyFrcQUKD5sQAt/L0LVGcErf7UVyW/CPqQv2v5wMJSbD1YQ=="}} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:43:04.497585 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.quota [None req-0b6e405d-5233-46de-b927-68cbc2634445 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Getting quotas for project c2ef57ea448a49d3af268a02f6f08257. Resources: {'ram', 'instances', 'cores'} {{(pid=124934) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 15:43:04.506525 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.quota [None req-0b6e405d-5233-46de-b927-68cbc2634445 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Getting quotas for user 6badcf8b92dc43a3bc2342e303dec1da and project c2ef57ea448a49d3af268a02f6f08257. Resources: {'ram', 'instances', 'cores'} {{(pid=124934) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 15:43:04.520142 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-0b6e405d-5233-46de-b927-68cbc2634445 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Going to run 1 instances... {{(pid=124934) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 15:43:04.522719 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-0b6e405d-5233-46de-b927-68cbc2634445 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] [instance: 450d3441-4eda-4616-b10f-13b39f479375] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5c8503f-3733-426f-8a5b-c7c9358e4a45',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124934) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 15:43:04.524019 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.quota [None req-e1cf7ae9-b90e-4a34-84ed-5373f24e0baa tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Getting quotas for project e0860b3d072246d49cd43a900351d571. Resources: {'key_pairs'} {{(pid=124933) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 15:43:04.528364 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.quota [None req-e1cf7ae9-b90e-4a34-84ed-5373f24e0baa tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Getting quotas for user 8b983c0a2a124ac3aa3403e0777612f7 and project e0860b3d072246d49cd43a900351d571. Resources: {'key_pairs'} {{(pid=124933) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 15:43:04.758331 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-e1cf7ae9-b90e-4a34-84ed-5373f24e0baa tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.574279 May 23 15:43:04.759202 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 91/193] 10.222.0.64 () {60 vars in 1158 bytes} [Mon May 23 15:43:04 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:43:04.767471 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-97811799-3442-467d-9ba8-3d42c970076b tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:04.767471 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-97811799-3442-467d-9ba8-3d42c970076b tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:04.782470 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-97811799-3442-467d-9ba8-3d42c970076b tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:04.785428 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-97811799-3442-467d-9ba8-3d42c970076b tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:04.786844 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-97811799-3442-467d-9ba8-3d42c970076b tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:04.788330 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-97811799-3442-467d-9ba8-3d42c970076b tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:04.818088 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-0b6e405d-5233-46de-b927-68cbc2634445 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.327104 May 23 15:43:04.826401 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 103/194] 10.222.0.64 () {60 vars in 1146 bytes} [Mon May 23 15:43:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1337 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 15:43:04.840439 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-2054e4ff-fafc-4da3-a8b1-c52c47832e17 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:04.840652 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-2054e4ff-fafc-4da3-a8b1-c52c47832e17 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] [instance: 450d3441-4eda-4616-b10f-13b39f479375] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:05.082576 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-2054e4ff-fafc-4da3-a8b1-c52c47832e17 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6badcf8b92dc43a3bc2342e303dec1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ef57ea448a49d3af268a02f6f08257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:05.093672 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-2054e4ff-fafc-4da3-a8b1-c52c47832e17 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] 10.222.0.64 "GET /compute/v2.1/servers/450d3441-4eda-4616-b10f-13b39f479375" status: 200 len: 1213 microversion: 2.1 time: 0.264837 May 23 15:43:05.095223 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 104/195] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:04 2022] GET /compute/v2.1/servers/450d3441-4eda-4616-b10f-13b39f479375 => generated 1213 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:05.157094 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-97811799-3442-467d-9ba8-3d42c970076b tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:05.171506 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-97811799-3442-467d-9ba8-3d42c970076b tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 200 len: 1519 microversion: 2.1 time: 0.410890 May 23 15:43:05.172604 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 92/196] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:04 2022] GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 1519 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:06.112321 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-dd684c00-ffc5-4bf2-b361-5a6176d4cc34 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:06.113578 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-dd684c00-ffc5-4bf2-b361-5a6176d4cc34 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] [instance: 450d3441-4eda-4616-b10f-13b39f479375] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:06.191319 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-0e89ef87-a988-4610-b7ee-e9559eba3c1d tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:06.192724 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-0e89ef87-a988-4610-b7ee-e9559eba3c1d tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:06.208736 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-dd684c00-ffc5-4bf2-b361-5a6176d4cc34 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6badcf8b92dc43a3bc2342e303dec1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ef57ea448a49d3af268a02f6f08257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:06.216924 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-dd684c00-ffc5-4bf2-b361-5a6176d4cc34 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] 10.222.0.64 "GET /compute/v2.1/servers/450d3441-4eda-4616-b10f-13b39f479375" status: 200 len: 1213 microversion: 2.1 time: 0.108982 May 23 15:43:06.218402 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-0e89ef87-a988-4610-b7ee-e9559eba3c1d tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:06.219662 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-0e89ef87-a988-4610-b7ee-e9559eba3c1d tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:06.221750 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 105/197] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:06 2022] GET /compute/v2.1/servers/450d3441-4eda-4616-b10f-13b39f479375 => generated 1213 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:06.222150 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-0e89ef87-a988-4610-b7ee-e9559eba3c1d tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:06.223587 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-0e89ef87-a988-4610-b7ee-e9559eba3c1d tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:06.686868 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-0e89ef87-a988-4610-b7ee-e9559eba3c1d tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:06.701222 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-0e89ef87-a988-4610-b7ee-e9559eba3c1d tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 200 len: 1519 microversion: 2.1 time: 0.514377 May 23 15:43:06.703779 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 93/198] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:06 2022] GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 1519 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:07.238118 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-0031f8f1-2a57-45ee-8c8b-6b904f22d66e tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:07.239376 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-0031f8f1-2a57-45ee-8c8b-6b904f22d66e tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] [instance: 450d3441-4eda-4616-b10f-13b39f479375] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:07.248376 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0031f8f1-2a57-45ee-8c8b-6b904f22d66e tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:07.252321 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0031f8f1-2a57-45ee-8c8b-6b904f22d66e tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:07.253530 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0031f8f1-2a57-45ee-8c8b-6b904f22d66e tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:07.256750 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0031f8f1-2a57-45ee-8c8b-6b904f22d66e tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:07.409925 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-0031f8f1-2a57-45ee-8c8b-6b904f22d66e tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6badcf8b92dc43a3bc2342e303dec1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ef57ea448a49d3af268a02f6f08257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:07.417783 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-0031f8f1-2a57-45ee-8c8b-6b904f22d66e tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] 10.222.0.64 "GET /compute/v2.1/servers/450d3441-4eda-4616-b10f-13b39f479375" status: 200 len: 1209 microversion: 2.1 time: 0.184630 May 23 15:43:07.418983 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 106/199] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:07 2022] GET /compute/v2.1/servers/450d3441-4eda-4616-b10f-13b39f479375 => generated 1209 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:07.720543 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-4337a0dd-c62c-4ef6-92b7-cd3cfe2ad969 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:07.721324 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-4337a0dd-c62c-4ef6-92b7-cd3cfe2ad969 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:07.733724 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-4337a0dd-c62c-4ef6-92b7-cd3cfe2ad969 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:07.740897 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-4337a0dd-c62c-4ef6-92b7-cd3cfe2ad969 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:07.741997 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-4337a0dd-c62c-4ef6-92b7-cd3cfe2ad969 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:07.743152 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-4337a0dd-c62c-4ef6-92b7-cd3cfe2ad969 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:08.084490 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-4337a0dd-c62c-4ef6-92b7-cd3cfe2ad969 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:08.096893 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-4337a0dd-c62c-4ef6-92b7-cd3cfe2ad969 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 200 len: 1519 microversion: 2.1 time: 0.379411 May 23 15:43:08.106317 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 94/200] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:07 2022] GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 1519 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:08.439271 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-ede63ddf-2425-4164-81ed-5fdeed548d3d tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:08.441185 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-ede63ddf-2425-4164-81ed-5fdeed548d3d tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] [instance: 450d3441-4eda-4616-b10f-13b39f479375] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:08.448976 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ede63ddf-2425-4164-81ed-5fdeed548d3d tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:08.449934 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ede63ddf-2425-4164-81ed-5fdeed548d3d tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:08.451455 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ede63ddf-2425-4164-81ed-5fdeed548d3d tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:08.461989 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ede63ddf-2425-4164-81ed-5fdeed548d3d tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:08.545688 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-ede63ddf-2425-4164-81ed-5fdeed548d3d tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6badcf8b92dc43a3bc2342e303dec1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ef57ea448a49d3af268a02f6f08257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:08.565207 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-ede63ddf-2425-4164-81ed-5fdeed548d3d tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] 10.222.0.64 "GET /compute/v2.1/servers/450d3441-4eda-4616-b10f-13b39f479375" status: 200 len: 1209 microversion: 2.1 time: 0.125296 May 23 15:43:08.575576 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 107/201] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:08 2022] GET /compute/v2.1/servers/450d3441-4eda-4616-b10f-13b39f479375 => generated 1209 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:09.114452 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-e209c061-730c-4f07-bb51-e03fa0f65f5f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:09.115645 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-e209c061-730c-4f07-bb51-e03fa0f65f5f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:09.139011 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e209c061-730c-4f07-bb51-e03fa0f65f5f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:09.139559 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e209c061-730c-4f07-bb51-e03fa0f65f5f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:09.140407 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e209c061-730c-4f07-bb51-e03fa0f65f5f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:09.141441 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e209c061-730c-4f07-bb51-e03fa0f65f5f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:09.430355 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-e209c061-730c-4f07-bb51-e03fa0f65f5f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:09.450987 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-e209c061-730c-4f07-bb51-e03fa0f65f5f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 200 len: 1519 microversion: 2.1 time: 0.338357 May 23 15:43:09.454053 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 95/202] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:09 2022] GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 1519 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:09.595740 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-0a908cfd-a5c8-413d-929f-3f1f9b8085a9 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:09.597350 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-0a908cfd-a5c8-413d-929f-3f1f9b8085a9 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] [instance: 450d3441-4eda-4616-b10f-13b39f479375] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:09.606893 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0a908cfd-a5c8-413d-929f-3f1f9b8085a9 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:09.606893 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0a908cfd-a5c8-413d-929f-3f1f9b8085a9 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:09.607504 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0a908cfd-a5c8-413d-929f-3f1f9b8085a9 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:09.608243 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0a908cfd-a5c8-413d-929f-3f1f9b8085a9 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:10.000647 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-0a908cfd-a5c8-413d-929f-3f1f9b8085a9 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6badcf8b92dc43a3bc2342e303dec1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ef57ea448a49d3af268a02f6f08257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:10.019414 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-0a908cfd-a5c8-413d-929f-3f1f9b8085a9 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] 10.222.0.64 "GET /compute/v2.1/servers/450d3441-4eda-4616-b10f-13b39f479375" status: 200 len: 1209 microversion: 2.1 time: 0.439966 May 23 15:43:10.022812 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 108/203] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:09 2022] GET /compute/v2.1/servers/450d3441-4eda-4616-b10f-13b39f479375 => generated 1209 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:10.471456 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-860a5635-ad26-4db5-a317-bca77a336d06 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:10.471960 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-860a5635-ad26-4db5-a317-bca77a336d06 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:10.474618 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:43:10.479525 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-860a5635-ad26-4db5-a317-bca77a336d06 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:10.480010 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-860a5635-ad26-4db5-a317-bca77a336d06 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:10.480791 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-860a5635-ad26-4db5-a317-bca77a336d06 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:10.481264 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-860a5635-ad26-4db5-a317-bca77a336d06 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:10.668677 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-860a5635-ad26-4db5-a317-bca77a336d06 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:10.677162 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-860a5635-ad26-4db5-a317-bca77a336d06 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 200 len: 1519 microversion: 2.1 time: 0.210385 May 23 15:43:10.677766 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 96/204] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:10 2022] GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 1519 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:10.894795 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-de126739-a562-4062-8b4c-3d407686d379 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Action: 'create', calling method: .version_select at 0x7fab5212a9d0>, body: {"keypair": {"name": "tempest-keypair-1168517304", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEbzVB2USB3QWLSWz5VmGTQD0BaxfnEOklM+Dp0InQSlytB+2j5NPf20P2Nngqqk4e62M1myvDU0qUPdJxWHQjxRvsuLeEhptHSWpE6tcr21hub5mfqeCbrlVWGCJC9VxA=="}} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:43:10.930586 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.quota [None req-de126739-a562-4062-8b4c-3d407686d379 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Getting quotas for project a15ae9d15a64468f80628ed51c2e42d6. Resources: {'key_pairs'} {{(pid=124934) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 15:43:10.942822 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.quota [None req-de126739-a562-4062-8b4c-3d407686d379 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Getting quotas for user 472049224bbf48699b8a9410ec61aa9e and project a15ae9d15a64468f80628ed51c2e42d6. Resources: {'key_pairs'} {{(pid=124934) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 15:43:11.039031 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-1c80a57e-c587-4608-ba4d-22ec370b36c3 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:11.039673 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-1c80a57e-c587-4608-ba4d-22ec370b36c3 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] [instance: 450d3441-4eda-4616-b10f-13b39f479375] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:11.045906 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1c80a57e-c587-4608-ba4d-22ec370b36c3 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:11.046548 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1c80a57e-c587-4608-ba4d-22ec370b36c3 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:11.047890 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1c80a57e-c587-4608-ba4d-22ec370b36c3 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:11.048332 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1c80a57e-c587-4608-ba4d-22ec370b36c3 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:11.081716 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-de126739-a562-4062-8b4c-3d407686d379 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.473114 May 23 15:43:11.082997 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 109/205] 10.222.0.64 () {60 vars in 1158 bytes} [Mon May 23 15:43:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:43:11.133613 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-1c80a57e-c587-4608-ba4d-22ec370b36c3 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6badcf8b92dc43a3bc2342e303dec1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ef57ea448a49d3af268a02f6f08257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:11.144921 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-1c80a57e-c587-4608-ba4d-22ec370b36c3 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] 10.222.0.64 "GET /compute/v2.1/servers/450d3441-4eda-4616-b10f-13b39f479375" status: 200 len: 1265 microversion: 2.1 time: 0.109575 May 23 15:43:11.145616 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 97/206] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:11 2022] GET /compute/v2.1/servers/450d3441-4eda-4616-b10f-13b39f479375 => generated 1265 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:43:11.696569 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-bb47c235-d7c2-477b-9868-24c90ef0bc89 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:11.697499 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-bb47c235-d7c2-477b-9868-24c90ef0bc89 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:11.701123 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=4 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:43:11.706299 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-bb47c235-d7c2-477b-9868-24c90ef0bc89 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:11.707178 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-bb47c235-d7c2-477b-9868-24c90ef0bc89 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:11.708195 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-bb47c235-d7c2-477b-9868-24c90ef0bc89 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:11.709182 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-bb47c235-d7c2-477b-9868-24c90ef0bc89 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:11.998702 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-bb47c235-d7c2-477b-9868-24c90ef0bc89 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:12.006670 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-bb47c235-d7c2-477b-9868-24c90ef0bc89 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 200 len: 1499 microversion: 2.1 time: 0.315806 May 23 15:43:12.008128 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 110/207] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:11 2022] GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 1499 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:12.025171 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-f586bf0a-a324-4836-be4e-f2efc2a75949 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:12.026450 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-f586bf0a-a324-4836-be4e-f2efc2a75949 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: bbe72f52-c8f9-46ea-ae59-9d2fe0a49523] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:12.035724 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-f586bf0a-a324-4836-be4e-f2efc2a75949 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:12.036471 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-f586bf0a-a324-4836-be4e-f2efc2a75949 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:12.037632 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-f586bf0a-a324-4836-be4e-f2efc2a75949 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:12.038227 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-f586bf0a-a324-4836-be4e-f2efc2a75949 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:12.164591 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-ff523c92-971d-46fd-9798-4f3b96581afa tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:12.165610 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-ff523c92-971d-46fd-9798-4f3b96581afa tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] [instance: 450d3441-4eda-4616-b10f-13b39f479375] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:12.172516 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ff523c92-971d-46fd-9798-4f3b96581afa tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:12.173294 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ff523c92-971d-46fd-9798-4f3b96581afa tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:12.179636 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ff523c92-971d-46fd-9798-4f3b96581afa tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:12.179636 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ff523c92-971d-46fd-9798-4f3b96581afa tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:12.274920 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-ff523c92-971d-46fd-9798-4f3b96581afa tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6badcf8b92dc43a3bc2342e303dec1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ef57ea448a49d3af268a02f6f08257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:12.289165 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-ff523c92-971d-46fd-9798-4f3b96581afa tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] 10.222.0.64 "GET /compute/v2.1/servers/450d3441-4eda-4616-b10f-13b39f479375" status: 200 len: 1271 microversion: 2.1 time: 0.130472 May 23 15:43:12.290318 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 111/208] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:12 2022] GET /compute/v2.1/servers/450d3441-4eda-4616-b10f-13b39f479375 => generated 1271 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:12.314939 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-f586bf0a-a324-4836-be4e-f2efc2a75949 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:12.331286 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-f586bf0a-a324-4836-be4e-f2efc2a75949 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523" status: 200 len: 1513 microversion: 2.1 time: 0.311061 May 23 15:43:12.332053 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 98/209] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:12 2022] GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523 => generated 1513 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:13.306655 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-da40e673-46c9-4b40-b95b-60d214f10ffa tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:13.307276 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-da40e673-46c9-4b40-b95b-60d214f10ffa tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] [instance: 450d3441-4eda-4616-b10f-13b39f479375] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:13.323231 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-da40e673-46c9-4b40-b95b-60d214f10ffa tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:13.323535 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-da40e673-46c9-4b40-b95b-60d214f10ffa tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:13.333748 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-da40e673-46c9-4b40-b95b-60d214f10ffa tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:13.334484 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-da40e673-46c9-4b40-b95b-60d214f10ffa tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:13.902514 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-da40e673-46c9-4b40-b95b-60d214f10ffa tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6badcf8b92dc43a3bc2342e303dec1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ef57ea448a49d3af268a02f6f08257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:13.917393 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-da40e673-46c9-4b40-b95b-60d214f10ffa tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] 10.222.0.64 "GET /compute/v2.1/servers/450d3441-4eda-4616-b10f-13b39f479375" status: 200 len: 1313 microversion: 2.1 time: 0.614450 May 23 15:43:13.918610 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 112/210] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:13 2022] GET /compute/v2.1/servers/450d3441-4eda-4616-b10f-13b39f479375 => generated 1313 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:14.556453 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_cell0:SELECT=4 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:43:14.561210 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-1a0e2749-6909-488f-8e93-d2bf72bc2517 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:43:14.565798 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-1a0e2749-6909-488f-8e93-d2bf72bc2517 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: bbe72f52-c8f9-46ea-ae59-9d2fe0a49523] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:14.585687 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1a0e2749-6909-488f-8e93-d2bf72bc2517 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:14.586149 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1a0e2749-6909-488f-8e93-d2bf72bc2517 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:14.586946 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1a0e2749-6909-488f-8e93-d2bf72bc2517 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:14.587389 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1a0e2749-6909-488f-8e93-d2bf72bc2517 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:14.604921 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [req-f8eeb494-61e3-41c8-b794-fd8d63ee464d req-74f64fc8-a24f-4bdd-885a-a5a1b5d47208 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "450d3441-4eda-4616-b10f-13b39f479375", "tag": "bbd71d32-cefe-4efd-a0d5-f2682da7cef4"}]} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:43:14.628696 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_cell0:SELECT=2 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:43:14.630790 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-f8eeb494-61e3-41c8-b794-fd8d63ee464d req-74f64fc8-a24f-4bdd-885a-a5a1b5d47208 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:14.631247 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-f8eeb494-61e3-41c8-b794-fd8d63ee464d req-74f64fc8-a24f-4bdd-885a-a5a1b5d47208 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:14.658662 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.compute.server_external_events [req-f8eeb494-61e3-41c8-b794-fd8d63ee464d req-74f64fc8-a24f-4bdd-885a-a5a1b5d47208 service nova] Creating event network-changed:bbd71d32-cefe-4efd-a0d5-f2682da7cef4 for instance 450d3441-4eda-4616-b10f-13b39f479375 on hv-cinder-84067 May 23 15:43:14.664506 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [req-f8eeb494-61e3-41c8-b794-fd8d63ee464d req-74f64fc8-a24f-4bdd-885a-a5a1b5d47208 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070016 May 23 15:43:14.665330 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 113/211] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:43:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:43:14.667703 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.objects.instance [None req-1a0e2749-6909-488f-8e93-d2bf72bc2517 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lazy-loading 'flavor' on Instance uuid bbe72f52-c8f9-46ea-ae59-9d2fe0a49523 {{(pid=124933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 15:43:14.685350 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-79dbcaeb-73d1-4f81-8d1e-4cfe601a7db9 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-223157494", "imageRef": "a5c8503f-3733-426f-8a5b-c7c9358e4a45", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6b67b25e-d689-4151-bafc-c9d67faaca84"}], "security_groups": [{"name": "tempest-securitygroup--221889475"}], "key_name": "tempest-keypair-1168517304", "user_data": "}} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:43:14.954368 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.network.neutron [None req-79dbcaeb-73d1-4f81-8d1e-4cfe601a7db9 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] validate_networks() for [('6b67b25e-d689-4151-bafc-c9d67faaca84', None, None, None, None, None)] {{(pid=124934) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 15:43:15.060825 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-1a0e2749-6909-488f-8e93-d2bf72bc2517 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "POST /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523/action" status: 200 len: 32 microversion: 2.1 time: 0.505361 May 23 15:43:15.061082 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 99/212] 10.222.0.64 () {60 vars in 1277 bytes} [Mon May 23 15:43:14 2022] POST /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523/action => generated 32 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 15:43:15.072457 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-c4b3e285-e8b5-4f41-9d69-5a4d070bbf96 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:15.074037 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-c4b3e285-e8b5-4f41-9d69-5a4d070bbf96 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] [instance: 450d3441-4eda-4616-b10f-13b39f479375] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:15.083893 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c4b3e285-e8b5-4f41-9d69-5a4d070bbf96 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:15.084532 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c4b3e285-e8b5-4f41-9d69-5a4d070bbf96 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:15.085637 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c4b3e285-e8b5-4f41-9d69-5a4d070bbf96 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:15.086569 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c4b3e285-e8b5-4f41-9d69-5a4d070bbf96 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:15.507651 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-c4b3e285-e8b5-4f41-9d69-5a4d070bbf96 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6badcf8b92dc43a3bc2342e303dec1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ef57ea448a49d3af268a02f6f08257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:15.518097 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-c4b3e285-e8b5-4f41-9d69-5a4d070bbf96 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] 10.222.0.64 "GET /compute/v2.1/servers/450d3441-4eda-4616-b10f-13b39f479375" status: 200 len: 1313 microversion: 2.1 time: 0.455127 May 23 15:43:15.519579 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 100/213] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:15 2022] GET /compute/v2.1/servers/450d3441-4eda-4616-b10f-13b39f479375 => generated 1313 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:15.526382 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-e6df9f54-e7ef-44f8-8ad3-cf47217fb4f4 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:15.527040 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-e6df9f54-e7ef-44f8-8ad3-cf47217fb4f4 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: bbe72f52-c8f9-46ea-ae59-9d2fe0a49523] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:15.534645 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e6df9f54-e7ef-44f8-8ad3-cf47217fb4f4 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:15.535340 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e6df9f54-e7ef-44f8-8ad3-cf47217fb4f4 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:15.537158 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e6df9f54-e7ef-44f8-8ad3-cf47217fb4f4 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:15.537820 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e6df9f54-e7ef-44f8-8ad3-cf47217fb4f4 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:15.841597 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-e6df9f54-e7ef-44f8-8ad3-cf47217fb4f4 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:15.850297 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-e6df9f54-e7ef-44f8-8ad3-cf47217fb4f4 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523" status: 200 len: 1519 microversion: 2.1 time: 0.330300 May 23 15:43:15.850869 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 101/214] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:15 2022] GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523 => generated 1519 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:16.166441 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.virt.hardware [None req-79dbcaeb-73d1-4f81-8d1e-4cfe601a7db9 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Flavor limits 0:0:0 {{(pid=124934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 15:43:16.167396 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.virt.hardware [None req-79dbcaeb-73d1-4f81-8d1e-4cfe601a7db9 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Image limits 0:0:0 {{(pid=124934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 15:43:16.167880 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.virt.hardware [None req-79dbcaeb-73d1-4f81-8d1e-4cfe601a7db9 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Flavor pref 0:0:0 {{(pid=124934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 15:43:16.168329 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.virt.hardware [None req-79dbcaeb-73d1-4f81-8d1e-4cfe601a7db9 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Image pref 0:0:0 {{(pid=124934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 15:43:16.168794 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.virt.hardware [None req-79dbcaeb-73d1-4f81-8d1e-4cfe601a7db9 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 15:43:16.183709 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-79dbcaeb-73d1-4f81-8d1e-4cfe601a7db9 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:16.188482 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-79dbcaeb-73d1-4f81-8d1e-4cfe601a7db9 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:16.188482 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-79dbcaeb-73d1-4f81-8d1e-4cfe601a7db9 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:16.188482 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-79dbcaeb-73d1-4f81-8d1e-4cfe601a7db9 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:16.205687 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.quota [None req-79dbcaeb-73d1-4f81-8d1e-4cfe601a7db9 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Getting quotas for project a15ae9d15a64468f80628ed51c2e42d6. Resources: {'ram', 'instances', 'cores'} {{(pid=124934) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 15:43:16.210114 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.quota [None req-79dbcaeb-73d1-4f81-8d1e-4cfe601a7db9 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Getting quotas for user 472049224bbf48699b8a9410ec61aa9e and project a15ae9d15a64468f80628ed51c2e42d6. Resources: {'ram', 'instances', 'cores'} {{(pid=124934) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 15:43:16.226143 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-79dbcaeb-73d1-4f81-8d1e-4cfe601a7db9 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Going to run 1 instances... {{(pid=124934) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 15:43:16.228544 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-79dbcaeb-73d1-4f81-8d1e-4cfe601a7db9 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: ce2cd056-b2f1-43fb-a60a-323039d15162] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5c8503f-3733-426f-8a5b-c7c9358e4a45',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124934) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 15:43:16.373284 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-79dbcaeb-73d1-4f81-8d1e-4cfe601a7db9 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.701000 May 23 15:43:16.374284 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 114/215] 10.222.0.64 () {60 vars in 1146 bytes} [Mon May 23 15:43:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 1703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 15:43:16.384457 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-7ffdc1ba-8c47-4100-b1e0-04f273b0a902 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:16.385345 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-7ffdc1ba-8c47-4100-b1e0-04f273b0a902 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: ce2cd056-b2f1-43fb-a60a-323039d15162] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:16.468342 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-7ffdc1ba-8c47-4100-b1e0-04f273b0a902 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:16.477789 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-7ffdc1ba-8c47-4100-b1e0-04f273b0a902 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162" status: 200 len: 1241 microversion: 2.1 time: 0.097122 May 23 15:43:16.478962 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 102/216] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:16 2022] GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162 => generated 1241 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:16.535978 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-1de6097a-56ca-4bb1-a3ac-138afc810f96 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:16.536724 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-1de6097a-56ca-4bb1-a3ac-138afc810f96 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] [instance: 450d3441-4eda-4616-b10f-13b39f479375] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:16.543462 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-1de6097a-56ca-4bb1-a3ac-138afc810f96 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:16.543904 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-1de6097a-56ca-4bb1-a3ac-138afc810f96 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:16.544671 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-1de6097a-56ca-4bb1-a3ac-138afc810f96 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:16.545416 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-1de6097a-56ca-4bb1-a3ac-138afc810f96 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:16.685677 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-1de6097a-56ca-4bb1-a3ac-138afc810f96 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6badcf8b92dc43a3bc2342e303dec1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ef57ea448a49d3af268a02f6f08257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:16.710898 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-1de6097a-56ca-4bb1-a3ac-138afc810f96 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] 10.222.0.64 "GET /compute/v2.1/servers/450d3441-4eda-4616-b10f-13b39f479375" status: 200 len: 1313 microversion: 2.1 time: 0.179367 May 23 15:43:16.711796 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 115/217] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:16 2022] GET /compute/v2.1/servers/450d3441-4eda-4616-b10f-13b39f479375 => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:16.871142 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-e068eadd-9322-4f1e-80a6-e4bd5412ae44 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:16.871955 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-e068eadd-9322-4f1e-80a6-e4bd5412ae44 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: bbe72f52-c8f9-46ea-ae59-9d2fe0a49523] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:16.899192 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e068eadd-9322-4f1e-80a6-e4bd5412ae44 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:16.901467 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e068eadd-9322-4f1e-80a6-e4bd5412ae44 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:16.904891 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e068eadd-9322-4f1e-80a6-e4bd5412ae44 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:16.908824 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e068eadd-9322-4f1e-80a6-e4bd5412ae44 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:17.240073 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-e068eadd-9322-4f1e-80a6-e4bd5412ae44 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:17.243515 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:43:17.247956 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-e068eadd-9322-4f1e-80a6-e4bd5412ae44 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523" status: 200 len: 1519 microversion: 2.1 time: 0.383646 May 23 15:43:17.250374 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 103/218] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:16 2022] GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523 => generated 1519 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:17.497082 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-60edac41-94da-4efb-9b20-6d18c4eaa501 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:17.497761 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-60edac41-94da-4efb-9b20-6d18c4eaa501 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: ce2cd056-b2f1-43fb-a60a-323039d15162] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:17.552749 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-60edac41-94da-4efb-9b20-6d18c4eaa501 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:17.560047 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-60edac41-94da-4efb-9b20-6d18c4eaa501 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162" status: 200 len: 1241 microversion: 2.1 time: 0.067431 May 23 15:43:17.560809 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 116/219] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:17 2022] GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162 => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:17.728307 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-69871378-adf5-49db-af22-5931ff6f3ca0 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:17.728922 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-69871378-adf5-49db-af22-5931ff6f3ca0 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] [instance: 450d3441-4eda-4616-b10f-13b39f479375] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:17.735555 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-69871378-adf5-49db-af22-5931ff6f3ca0 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:17.736036 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-69871378-adf5-49db-af22-5931ff6f3ca0 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:17.736816 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-69871378-adf5-49db-af22-5931ff6f3ca0 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:17.737469 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-69871378-adf5-49db-af22-5931ff6f3ca0 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:17.880087 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-69871378-adf5-49db-af22-5931ff6f3ca0 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6badcf8b92dc43a3bc2342e303dec1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ef57ea448a49d3af268a02f6f08257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:17.887531 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-69871378-adf5-49db-af22-5931ff6f3ca0 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] 10.222.0.64 "GET /compute/v2.1/servers/450d3441-4eda-4616-b10f-13b39f479375" status: 200 len: 1313 microversion: 2.1 time: 0.163072 May 23 15:43:17.888100 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 104/220] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:17 2022] GET /compute/v2.1/servers/450d3441-4eda-4616-b10f-13b39f479375 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:18.266831 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-7b67c74f-ad01-4589-913c-2d6b6c96be4f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:18.267705 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-7b67c74f-ad01-4589-913c-2d6b6c96be4f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: bbe72f52-c8f9-46ea-ae59-9d2fe0a49523] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:18.274370 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-7b67c74f-ad01-4589-913c-2d6b6c96be4f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:18.274816 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-7b67c74f-ad01-4589-913c-2d6b6c96be4f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:18.275595 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-7b67c74f-ad01-4589-913c-2d6b6c96be4f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:18.276041 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-7b67c74f-ad01-4589-913c-2d6b6c96be4f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:18.466223 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-7b67c74f-ad01-4589-913c-2d6b6c96be4f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:18.474792 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-7b67c74f-ad01-4589-913c-2d6b6c96be4f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523" status: 200 len: 1519 microversion: 2.1 time: 0.211949 May 23 15:43:18.475473 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 117/221] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:18 2022] GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523 => generated 1519 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:18.577234 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-dca892a2-eb3c-4652-b4e7-207266c34c33 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:18.577917 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-dca892a2-eb3c-4652-b4e7-207266c34c33 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: ce2cd056-b2f1-43fb-a60a-323039d15162] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:18.585118 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-dca892a2-eb3c-4652-b4e7-207266c34c33 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:18.585570 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-dca892a2-eb3c-4652-b4e7-207266c34c33 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:18.586339 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-dca892a2-eb3c-4652-b4e7-207266c34c33 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:18.586770 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-dca892a2-eb3c-4652-b4e7-207266c34c33 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:18.651467 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-dca892a2-eb3c-4652-b4e7-207266c34c33 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:18.660871 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-dca892a2-eb3c-4652-b4e7-207266c34c33 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162" status: 200 len: 1245 microversion: 2.1 time: 0.087758 May 23 15:43:18.661567 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 105/222] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:18 2022] GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162 => generated 1245 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:18.905418 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-8d780fb0-8573-454b-bfe7-efb00e278385 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:18.906043 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-8d780fb0-8573-454b-bfe7-efb00e278385 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] [instance: 450d3441-4eda-4616-b10f-13b39f479375] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:18.912733 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-8d780fb0-8573-454b-bfe7-efb00e278385 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:18.913232 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-8d780fb0-8573-454b-bfe7-efb00e278385 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:18.914070 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-8d780fb0-8573-454b-bfe7-efb00e278385 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:18.914433 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-8d780fb0-8573-454b-bfe7-efb00e278385 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:19.053701 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-8d780fb0-8573-454b-bfe7-efb00e278385 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6badcf8b92dc43a3bc2342e303dec1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ef57ea448a49d3af268a02f6f08257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:19.061037 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-8d780fb0-8573-454b-bfe7-efb00e278385 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] 10.222.0.64 "GET /compute/v2.1/servers/450d3441-4eda-4616-b10f-13b39f479375" status: 200 len: 1313 microversion: 2.1 time: 0.159565 May 23 15:43:19.061620 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 118/223] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:18 2022] GET /compute/v2.1/servers/450d3441-4eda-4616-b10f-13b39f479375 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:19.494304 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-8718a01e-f63f-4962-aef1-adce6cf7f38c tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:19.495109 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-8718a01e-f63f-4962-aef1-adce6cf7f38c tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: bbe72f52-c8f9-46ea-ae59-9d2fe0a49523] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:19.503803 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-8718a01e-f63f-4962-aef1-adce6cf7f38c tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:19.504496 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-8718a01e-f63f-4962-aef1-adce6cf7f38c tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:19.507636 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-8718a01e-f63f-4962-aef1-adce6cf7f38c tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:19.507636 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-8718a01e-f63f-4962-aef1-adce6cf7f38c tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:19.638043 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-8718a01e-f63f-4962-aef1-adce6cf7f38c tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:19.646658 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-8718a01e-f63f-4962-aef1-adce6cf7f38c tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523" status: 200 len: 1519 microversion: 2.1 time: 0.158513 May 23 15:43:19.647230 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 106/224] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:19 2022] GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:19.679241 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-0cee9886-4846-40cc-b647-cc33be46d3d6 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:19.679865 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-0cee9886-4846-40cc-b647-cc33be46d3d6 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: ce2cd056-b2f1-43fb-a60a-323039d15162] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:19.685941 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0cee9886-4846-40cc-b647-cc33be46d3d6 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:19.686396 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0cee9886-4846-40cc-b647-cc33be46d3d6 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:19.687166 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0cee9886-4846-40cc-b647-cc33be46d3d6 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:19.687602 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0cee9886-4846-40cc-b647-cc33be46d3d6 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:19.748970 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-0cee9886-4846-40cc-b647-cc33be46d3d6 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:19.753154 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_cell1:SELECT=100 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:43:19.757490 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-0cee9886-4846-40cc-b647-cc33be46d3d6 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162" status: 200 len: 1245 microversion: 2.1 time: 0.082094 May 23 15:43:19.758043 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 119/225] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:19 2022] GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:20.081287 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-ff8225ca-1176-4bc9-9ef6-f57b76761d5c tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:20.082584 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-ff8225ca-1176-4bc9-9ef6-f57b76761d5c tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] [instance: 450d3441-4eda-4616-b10f-13b39f479375] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:20.095601 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ff8225ca-1176-4bc9-9ef6-f57b76761d5c tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:20.098403 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ff8225ca-1176-4bc9-9ef6-f57b76761d5c tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:20.099394 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ff8225ca-1176-4bc9-9ef6-f57b76761d5c tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:20.101710 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ff8225ca-1176-4bc9-9ef6-f57b76761d5c tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:20.287312 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-ff8225ca-1176-4bc9-9ef6-f57b76761d5c tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6badcf8b92dc43a3bc2342e303dec1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ef57ea448a49d3af268a02f6f08257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:20.296481 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-ff8225ca-1176-4bc9-9ef6-f57b76761d5c tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] 10.222.0.64 "GET /compute/v2.1/servers/450d3441-4eda-4616-b10f-13b39f479375" status: 200 len: 1313 microversion: 2.1 time: 0.220394 May 23 15:43:20.297109 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 107/226] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:20 2022] GET /compute/v2.1/servers/450d3441-4eda-4616-b10f-13b39f479375 => generated 1313 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:20.664102 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-275279b5-274a-4c32-9aae-53822cc07ca9 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:20.664741 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-275279b5-274a-4c32-9aae-53822cc07ca9 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: bbe72f52-c8f9-46ea-ae59-9d2fe0a49523] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:20.671185 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-275279b5-274a-4c32-9aae-53822cc07ca9 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:20.671632 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-275279b5-274a-4c32-9aae-53822cc07ca9 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:20.672386 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-275279b5-274a-4c32-9aae-53822cc07ca9 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:20.672818 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-275279b5-274a-4c32-9aae-53822cc07ca9 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:20.774806 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-a3fa35b7-c1d4-4bd0-a952-f8a98cbaa886 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:20.775514 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-a3fa35b7-c1d4-4bd0-a952-f8a98cbaa886 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: ce2cd056-b2f1-43fb-a60a-323039d15162] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:20.784616 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a3fa35b7-c1d4-4bd0-a952-f8a98cbaa886 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:20.785186 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a3fa35b7-c1d4-4bd0-a952-f8a98cbaa886 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:20.786088 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a3fa35b7-c1d4-4bd0-a952-f8a98cbaa886 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:20.786772 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a3fa35b7-c1d4-4bd0-a952-f8a98cbaa886 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:20.808292 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-275279b5-274a-4c32-9aae-53822cc07ca9 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:20.816842 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-275279b5-274a-4c32-9aae-53822cc07ca9 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523" status: 200 len: 1519 microversion: 2.1 time: 0.156629 May 23 15:43:20.817447 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 120/227] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:20 2022] GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:20.852108 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-a3fa35b7-c1d4-4bd0-a952-f8a98cbaa886 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:20.859614 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-a3fa35b7-c1d4-4bd0-a952-f8a98cbaa886 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162" status: 200 len: 1237 microversion: 2.1 time: 0.089427 May 23 15:43:20.860182 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 108/228] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:20 2022] GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162 => generated 1237 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:21.315391 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-2fdbf16f-4171-41f8-8b2c-d17f0655234b tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:21.316000 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-2fdbf16f-4171-41f8-8b2c-d17f0655234b tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] [instance: 450d3441-4eda-4616-b10f-13b39f479375] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:21.322327 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2fdbf16f-4171-41f8-8b2c-d17f0655234b tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:21.322794 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2fdbf16f-4171-41f8-8b2c-d17f0655234b tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:21.323546 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2fdbf16f-4171-41f8-8b2c-d17f0655234b tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:21.323976 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2fdbf16f-4171-41f8-8b2c-d17f0655234b tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:21.460923 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-2fdbf16f-4171-41f8-8b2c-d17f0655234b tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6badcf8b92dc43a3bc2342e303dec1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ef57ea448a49d3af268a02f6f08257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:21.468343 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-2fdbf16f-4171-41f8-8b2c-d17f0655234b tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] 10.222.0.64 "GET /compute/v2.1/servers/450d3441-4eda-4616-b10f-13b39f479375" status: 200 len: 1313 microversion: 2.1 time: 0.157457 May 23 15:43:21.469238 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 121/229] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:21 2022] GET /compute/v2.1/servers/450d3441-4eda-4616-b10f-13b39f479375 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:21.838685 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-179e1b5e-271b-4c5a-8b1e-3c603816fbe1 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:21.839540 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-179e1b5e-271b-4c5a-8b1e-3c603816fbe1 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: bbe72f52-c8f9-46ea-ae59-9d2fe0a49523] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:21.858436 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-179e1b5e-271b-4c5a-8b1e-3c603816fbe1 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:21.859151 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-179e1b5e-271b-4c5a-8b1e-3c603816fbe1 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:21.860032 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-179e1b5e-271b-4c5a-8b1e-3c603816fbe1 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:21.862256 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-179e1b5e-271b-4c5a-8b1e-3c603816fbe1 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:21.880495 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-5ad25c7c-e24e-40ac-b05e-589fe465250d tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:21.881290 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-5ad25c7c-e24e-40ac-b05e-589fe465250d tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: ce2cd056-b2f1-43fb-a60a-323039d15162] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:21.888319 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5ad25c7c-e24e-40ac-b05e-589fe465250d tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:21.888784 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5ad25c7c-e24e-40ac-b05e-589fe465250d tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:21.889828 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5ad25c7c-e24e-40ac-b05e-589fe465250d tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:21.890317 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5ad25c7c-e24e-40ac-b05e-589fe465250d tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:22.019538 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-5ad25c7c-e24e-40ac-b05e-589fe465250d tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:22.027807 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-5ad25c7c-e24e-40ac-b05e-589fe465250d tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162" status: 200 len: 1311 microversion: 2.1 time: 0.153210 May 23 15:43:22.038005 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 122/230] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:21 2022] GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162 => generated 1311 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:43:22.145422 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-179e1b5e-271b-4c5a-8b1e-3c603816fbe1 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:22.153508 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-179e1b5e-271b-4c5a-8b1e-3c603816fbe1 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523" status: 200 len: 1519 microversion: 2.1 time: 0.322335 May 23 15:43:22.154422 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 109/231] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:21 2022] GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523 => generated 1519 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:22.210104 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [req-77bced0f-9770-41ec-9e73-6d260a933511 req-a9bd581c-f594-4df7-8fb7-f918bc654c01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "450d3441-4eda-4616-b10f-13b39f479375", "name": "network-vif-plugged", "status": "completed", "tag": "bbd71d32-cefe-4efd-a0d5-f2682da7cef4"}]} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:43:22.219185 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-77bced0f-9770-41ec-9e73-6d260a933511 req-a9bd581c-f594-4df7-8fb7-f918bc654c01 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:22.219806 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-77bced0f-9770-41ec-9e73-6d260a933511 req-a9bd581c-f594-4df7-8fb7-f918bc654c01 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:22.238507 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.compute.server_external_events [req-77bced0f-9770-41ec-9e73-6d260a933511 req-a9bd581c-f594-4df7-8fb7-f918bc654c01 service nova] Creating event network-vif-plugged:bbd71d32-cefe-4efd-a0d5-f2682da7cef4 for instance 450d3441-4eda-4616-b10f-13b39f479375 on hv-cinder-84067 May 23 15:43:22.243835 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [req-77bced0f-9770-41ec-9e73-6d260a933511 req-a9bd581c-f594-4df7-8fb7-f918bc654c01 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037611 May 23 15:43:22.244425 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 123/232] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:43:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:43:22.487217 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-37fd1a23-3c5f-47b5-95b0-b8119763d63a tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:22.487751 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-37fd1a23-3c5f-47b5-95b0-b8119763d63a tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] [instance: 450d3441-4eda-4616-b10f-13b39f479375] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:22.493850 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-37fd1a23-3c5f-47b5-95b0-b8119763d63a tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:22.494285 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-37fd1a23-3c5f-47b5-95b0-b8119763d63a tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:22.495050 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-37fd1a23-3c5f-47b5-95b0-b8119763d63a tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:22.495487 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-37fd1a23-3c5f-47b5-95b0-b8119763d63a tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:22.630568 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-37fd1a23-3c5f-47b5-95b0-b8119763d63a tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6badcf8b92dc43a3bc2342e303dec1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ef57ea448a49d3af268a02f6f08257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:22.639605 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-37fd1a23-3c5f-47b5-95b0-b8119763d63a tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] 10.222.0.64 "GET /compute/v2.1/servers/450d3441-4eda-4616-b10f-13b39f479375" status: 200 len: 1313 microversion: 2.1 time: 0.156766 May 23 15:43:22.640174 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 110/233] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:22 2022] GET /compute/v2.1/servers/450d3441-4eda-4616-b10f-13b39f479375 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:23.046267 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-61f236db-e719-4476-a8a3-09657b74c604 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:23.047071 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-61f236db-e719-4476-a8a3-09657b74c604 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: ce2cd056-b2f1-43fb-a60a-323039d15162] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:23.054036 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-61f236db-e719-4476-a8a3-09657b74c604 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:23.054483 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-61f236db-e719-4476-a8a3-09657b74c604 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:23.055237 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-61f236db-e719-4476-a8a3-09657b74c604 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:23.055709 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-61f236db-e719-4476-a8a3-09657b74c604 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:23.171511 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-c9bc6d3a-f3f4-4df4-8e48-bbc67cf68f52 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:23.172095 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-c9bc6d3a-f3f4-4df4-8e48-bbc67cf68f52 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: bbe72f52-c8f9-46ea-ae59-9d2fe0a49523] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:23.180110 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c9bc6d3a-f3f4-4df4-8e48-bbc67cf68f52 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:23.180593 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c9bc6d3a-f3f4-4df4-8e48-bbc67cf68f52 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:23.181372 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c9bc6d3a-f3f4-4df4-8e48-bbc67cf68f52 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:23.181812 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c9bc6d3a-f3f4-4df4-8e48-bbc67cf68f52 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:23.191584 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-61f236db-e719-4476-a8a3-09657b74c604 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:23.199379 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-61f236db-e719-4476-a8a3-09657b74c604 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162" status: 200 len: 1366 microversion: 2.1 time: 0.157587 May 23 15:43:23.209341 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 124/234] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:23 2022] GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:23.316885 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-c9bc6d3a-f3f4-4df4-8e48-bbc67cf68f52 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:23.324342 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-c9bc6d3a-f3f4-4df4-8e48-bbc67cf68f52 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523" status: 200 len: 1519 microversion: 2.1 time: 0.156968 May 23 15:43:23.324909 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 111/235] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:23 2022] GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:23.656208 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-1eed4e3d-0882-4e1d-832b-42ae25dea0fc tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:23.657031 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-1eed4e3d-0882-4e1d-832b-42ae25dea0fc tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] [instance: 450d3441-4eda-4616-b10f-13b39f479375] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:23.667007 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-1eed4e3d-0882-4e1d-832b-42ae25dea0fc tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:23.667007 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-1eed4e3d-0882-4e1d-832b-42ae25dea0fc tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:23.667007 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-1eed4e3d-0882-4e1d-832b-42ae25dea0fc tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:23.667007 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-1eed4e3d-0882-4e1d-832b-42ae25dea0fc tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:23.800979 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-1eed4e3d-0882-4e1d-832b-42ae25dea0fc tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6badcf8b92dc43a3bc2342e303dec1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ef57ea448a49d3af268a02f6f08257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:23.808471 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-1eed4e3d-0882-4e1d-832b-42ae25dea0fc tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] 10.222.0.64 "GET /compute/v2.1/servers/450d3441-4eda-4616-b10f-13b39f479375" status: 200 len: 1313 microversion: 2.1 time: 0.156059 May 23 15:43:23.809035 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 125/236] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:23 2022] GET /compute/v2.1/servers/450d3441-4eda-4616-b10f-13b39f479375 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:24.215701 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-2ff73ae6-ef47-4463-86b9-53f9f8b04f5a tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:24.216317 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-2ff73ae6-ef47-4463-86b9-53f9f8b04f5a tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: ce2cd056-b2f1-43fb-a60a-323039d15162] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:24.223090 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-2ff73ae6-ef47-4463-86b9-53f9f8b04f5a tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:24.223550 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-2ff73ae6-ef47-4463-86b9-53f9f8b04f5a tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:24.224474 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-2ff73ae6-ef47-4463-86b9-53f9f8b04f5a tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:24.224750 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-2ff73ae6-ef47-4463-86b9-53f9f8b04f5a tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:24.341510 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-5727e5b3-4518-476b-b36d-bfa508af52ae tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:24.342400 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-5727e5b3-4518-476b-b36d-bfa508af52ae tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: bbe72f52-c8f9-46ea-ae59-9d2fe0a49523] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:24.348285 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5727e5b3-4518-476b-b36d-bfa508af52ae tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:24.348759 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5727e5b3-4518-476b-b36d-bfa508af52ae tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:24.349548 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5727e5b3-4518-476b-b36d-bfa508af52ae tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:24.349981 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5727e5b3-4518-476b-b36d-bfa508af52ae tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:24.356325 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-2ff73ae6-ef47-4463-86b9-53f9f8b04f5a tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:24.364876 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-2ff73ae6-ef47-4463-86b9-53f9f8b04f5a tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162" status: 200 len: 1366 microversion: 2.1 time: 0.153024 May 23 15:43:24.366000 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 112/237] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:24 2022] GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:24.477251 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-5727e5b3-4518-476b-b36d-bfa508af52ae tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:24.484598 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-5727e5b3-4518-476b-b36d-bfa508af52ae tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523" status: 200 len: 1519 microversion: 2.1 time: 0.146873 May 23 15:43:24.485168 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 126/238] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:24 2022] GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523 => generated 1519 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:43:24.689743 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-a0fab07f-5ea2-4691-bcaa-318a26e83bc2 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:24.690167 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-a0fab07f-5ea2-4691-bcaa-318a26e83bc2 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:24.696223 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a0fab07f-5ea2-4691-bcaa-318a26e83bc2 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:24.696681 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a0fab07f-5ea2-4691-bcaa-318a26e83bc2 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:24.698220 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a0fab07f-5ea2-4691-bcaa-318a26e83bc2 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:24.698220 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a0fab07f-5ea2-4691-bcaa-318a26e83bc2 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:24.723837 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-a0fab07f-5ea2-4691-bcaa-318a26e83bc2 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358/ips" status: 200 len: 145 microversion: 2.1 time: 0.038564 May 23 15:43:24.724425 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 113/239] 10.222.0.64 () {58 vars in 1247 bytes} [Mon May 23 15:43:24 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358/ips => generated 145 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:43:24.824741 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-290923aa-8ccd-4a0b-a146-b064cbd6e638 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:24.827028 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-290923aa-8ccd-4a0b-a146-b064cbd6e638 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] [instance: 450d3441-4eda-4616-b10f-13b39f479375] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:24.832128 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-290923aa-8ccd-4a0b-a146-b064cbd6e638 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:24.832580 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-290923aa-8ccd-4a0b-a146-b064cbd6e638 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:24.833360 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-290923aa-8ccd-4a0b-a146-b064cbd6e638 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:24.833905 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-290923aa-8ccd-4a0b-a146-b064cbd6e638 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:24.970859 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-290923aa-8ccd-4a0b-a146-b064cbd6e638 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6badcf8b92dc43a3bc2342e303dec1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ef57ea448a49d3af268a02f6f08257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:24.977889 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-290923aa-8ccd-4a0b-a146-b064cbd6e638 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] 10.222.0.64 "GET /compute/v2.1/servers/450d3441-4eda-4616-b10f-13b39f479375" status: 200 len: 1313 microversion: 2.1 time: 0.156908 May 23 15:43:24.978446 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 127/240] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:24 2022] GET /compute/v2.1/servers/450d3441-4eda-4616-b10f-13b39f479375 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:25.382534 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-53cafe0d-a57b-48f6-90c3-f15cd8b638e0 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:25.383292 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-53cafe0d-a57b-48f6-90c3-f15cd8b638e0 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: ce2cd056-b2f1-43fb-a60a-323039d15162] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:25.390549 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-53cafe0d-a57b-48f6-90c3-f15cd8b638e0 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:25.391104 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-53cafe0d-a57b-48f6-90c3-f15cd8b638e0 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:25.392632 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-53cafe0d-a57b-48f6-90c3-f15cd8b638e0 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:25.393112 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-53cafe0d-a57b-48f6-90c3-f15cd8b638e0 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:25.503549 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-8bccb793-817f-452b-8118-de6019771708 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:25.507187 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-8bccb793-817f-452b-8118-de6019771708 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: bbe72f52-c8f9-46ea-ae59-9d2fe0a49523] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:25.513632 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-8bccb793-817f-452b-8118-de6019771708 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:25.514084 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-8bccb793-817f-452b-8118-de6019771708 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:25.515042 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-8bccb793-817f-452b-8118-de6019771708 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:25.515478 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-8bccb793-817f-452b-8118-de6019771708 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:25.738677 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-53cafe0d-a57b-48f6-90c3-f15cd8b638e0 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:25.746223 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-53cafe0d-a57b-48f6-90c3-f15cd8b638e0 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162" status: 200 len: 1366 microversion: 2.1 time: 0.367890 May 23 15:43:25.746787 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 114/241] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:25 2022] GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162 => generated 1366 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:25.819083 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-8bccb793-817f-452b-8118-de6019771708 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:25.826791 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-8bccb793-817f-452b-8118-de6019771708 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523" status: 200 len: 1519 microversion: 2.1 time: 0.327832 May 23 15:43:25.827676 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 128/242] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:25 2022] GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523 => generated 1519 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:25.998962 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-0d1670a7-da1c-4754-9857-01f559fa5162 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:26.000440 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-0d1670a7-da1c-4754-9857-01f559fa5162 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] [instance: 450d3441-4eda-4616-b10f-13b39f479375] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:26.025586 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-0d1670a7-da1c-4754-9857-01f559fa5162 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:26.026166 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-0d1670a7-da1c-4754-9857-01f559fa5162 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:26.027936 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-0d1670a7-da1c-4754-9857-01f559fa5162 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:26.028386 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-0d1670a7-da1c-4754-9857-01f559fa5162 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:26.262429 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-0d1670a7-da1c-4754-9857-01f559fa5162 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6badcf8b92dc43a3bc2342e303dec1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ef57ea448a49d3af268a02f6f08257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:26.269446 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-0d1670a7-da1c-4754-9857-01f559fa5162 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] 10.222.0.64 "GET /compute/v2.1/servers/450d3441-4eda-4616-b10f-13b39f479375" status: 200 len: 1313 microversion: 2.1 time: 0.277407 May 23 15:43:26.274579 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 115/243] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:25 2022] GET /compute/v2.1/servers/450d3441-4eda-4616-b10f-13b39f479375 => generated 1313 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:26.526408 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [req-038f3b65-55ae-4765-9506-2bcb9049b7d0 req-a39a816d-a328-487a-8334-7eba3648c615 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce2cd056-b2f1-43fb-a60a-323039d15162", "tag": "cefdd54f-7186-4994-802f-370961a2ffcb"}]} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:43:26.530738 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_cell0:SELECT=2 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:43:26.539240 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-038f3b65-55ae-4765-9506-2bcb9049b7d0 req-a39a816d-a328-487a-8334-7eba3648c615 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:26.539701 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-038f3b65-55ae-4765-9506-2bcb9049b7d0 req-a39a816d-a328-487a-8334-7eba3648c615 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:26.553808 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.compute.server_external_events [req-038f3b65-55ae-4765-9506-2bcb9049b7d0 req-a39a816d-a328-487a-8334-7eba3648c615 service nova] Creating event network-changed:cefdd54f-7186-4994-802f-370961a2ffcb for instance ce2cd056-b2f1-43fb-a60a-323039d15162 on hv-cinder-84067 May 23 15:43:26.561868 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [req-038f3b65-55ae-4765-9506-2bcb9049b7d0 req-a39a816d-a328-487a-8334-7eba3648c615 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042332 May 23 15:43:26.562755 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 129/244] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:43:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:43:26.763648 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-d9272ece-2799-434b-87aa-51fd9e52569a tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:26.764325 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-d9272ece-2799-434b-87aa-51fd9e52569a tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: ce2cd056-b2f1-43fb-a60a-323039d15162] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:26.766317 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_cell0:SELECT=2 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:43:26.771562 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-d9272ece-2799-434b-87aa-51fd9e52569a tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:26.772207 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-d9272ece-2799-434b-87aa-51fd9e52569a tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:26.772977 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-d9272ece-2799-434b-87aa-51fd9e52569a tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:26.773444 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-d9272ece-2799-434b-87aa-51fd9e52569a tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:26.844517 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-b630486b-b7d4-4eb5-b225-29c4cbfe95c5 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:26.846058 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-b630486b-b7d4-4eb5-b225-29c4cbfe95c5 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: bbe72f52-c8f9-46ea-ae59-9d2fe0a49523] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:26.854767 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-b630486b-b7d4-4eb5-b225-29c4cbfe95c5 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:26.855234 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-b630486b-b7d4-4eb5-b225-29c4cbfe95c5 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:26.856274 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-b630486b-b7d4-4eb5-b225-29c4cbfe95c5 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:26.856847 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-b630486b-b7d4-4eb5-b225-29c4cbfe95c5 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:26.952489 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-d9272ece-2799-434b-87aa-51fd9e52569a tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:26.960091 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-d9272ece-2799-434b-87aa-51fd9e52569a tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162" status: 200 len: 1366 microversion: 2.1 time: 0.200277 May 23 15:43:26.960656 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 116/245] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:26 2022] GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162 => generated 1366 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:27.017157 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-b630486b-b7d4-4eb5-b225-29c4cbfe95c5 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:27.025009 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-b630486b-b7d4-4eb5-b225-29c4cbfe95c5 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523" status: 200 len: 1519 microversion: 2.1 time: 0.184888 May 23 15:43:27.025758 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 130/246] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:26 2022] GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523 => generated 1519 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:43:27.287003 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-2158d9c4-6a4c-4f6d-a1f3-48e57815dfef tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:27.287622 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-2158d9c4-6a4c-4f6d-a1f3-48e57815dfef tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] [instance: 450d3441-4eda-4616-b10f-13b39f479375] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:27.293624 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-2158d9c4-6a4c-4f6d-a1f3-48e57815dfef tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:27.294266 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-2158d9c4-6a4c-4f6d-a1f3-48e57815dfef tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:27.295491 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-2158d9c4-6a4c-4f6d-a1f3-48e57815dfef tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:27.295939 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-2158d9c4-6a4c-4f6d-a1f3-48e57815dfef tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:27.435030 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-2158d9c4-6a4c-4f6d-a1f3-48e57815dfef tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6badcf8b92dc43a3bc2342e303dec1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ef57ea448a49d3af268a02f6f08257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:27.443310 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-2158d9c4-6a4c-4f6d-a1f3-48e57815dfef tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] 10.222.0.64 "GET /compute/v2.1/servers/450d3441-4eda-4616-b10f-13b39f479375" status: 200 len: 1313 microversion: 2.1 time: 0.160911 May 23 15:43:27.443873 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 117/247] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:27 2022] GET /compute/v2.1/servers/450d3441-4eda-4616-b10f-13b39f479375 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:27.977035 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-0a7fe22a-7a45-4e42-94c7-9c9c1de3e579 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:27.977681 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-0a7fe22a-7a45-4e42-94c7-9c9c1de3e579 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: ce2cd056-b2f1-43fb-a60a-323039d15162] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:27.979611 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_cell0:SELECT=22 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:43:27.984645 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0a7fe22a-7a45-4e42-94c7-9c9c1de3e579 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:27.985125 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0a7fe22a-7a45-4e42-94c7-9c9c1de3e579 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:27.986585 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0a7fe22a-7a45-4e42-94c7-9c9c1de3e579 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:27.987030 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0a7fe22a-7a45-4e42-94c7-9c9c1de3e579 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:28.043339 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-6687f7f0-2b3b-4d84-8be8-2e2b6ec6656f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:28.043883 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-6687f7f0-2b3b-4d84-8be8-2e2b6ec6656f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: bbe72f52-c8f9-46ea-ae59-9d2fe0a49523] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:28.050763 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-6687f7f0-2b3b-4d84-8be8-2e2b6ec6656f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:28.051222 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-6687f7f0-2b3b-4d84-8be8-2e2b6ec6656f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:28.052046 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-6687f7f0-2b3b-4d84-8be8-2e2b6ec6656f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:28.052493 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-6687f7f0-2b3b-4d84-8be8-2e2b6ec6656f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:28.379225 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-0a7fe22a-7a45-4e42-94c7-9c9c1de3e579 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:28.386645 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-0a7fe22a-7a45-4e42-94c7-9c9c1de3e579 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162" status: 200 len: 1366 microversion: 2.1 time: 0.413355 May 23 15:43:28.387220 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 131/248] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:27 2022] GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162 => generated 1366 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:28.424856 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-6687f7f0-2b3b-4d84-8be8-2e2b6ec6656f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:28.432438 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-6687f7f0-2b3b-4d84-8be8-2e2b6ec6656f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523" status: 200 len: 1519 microversion: 2.1 time: 0.393130 May 23 15:43:28.433003 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 118/249] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:28 2022] GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523 => generated 1519 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:43:28.460688 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-3645f355-74b7-49ca-bd89-9183c5d45c62 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:28.461322 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-3645f355-74b7-49ca-bd89-9183c5d45c62 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] [instance: 450d3441-4eda-4616-b10f-13b39f479375] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:28.467536 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3645f355-74b7-49ca-bd89-9183c5d45c62 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:28.467984 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3645f355-74b7-49ca-bd89-9183c5d45c62 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:28.468759 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3645f355-74b7-49ca-bd89-9183c5d45c62 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:28.469399 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3645f355-74b7-49ca-bd89-9183c5d45c62 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:28.603820 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-3645f355-74b7-49ca-bd89-9183c5d45c62 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6badcf8b92dc43a3bc2342e303dec1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ef57ea448a49d3af268a02f6f08257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:28.611894 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-3645f355-74b7-49ca-bd89-9183c5d45c62 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] 10.222.0.64 "GET /compute/v2.1/servers/450d3441-4eda-4616-b10f-13b39f479375" status: 200 len: 1313 microversion: 2.1 time: 0.155015 May 23 15:43:28.612590 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 132/250] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:28 2022] GET /compute/v2.1/servers/450d3441-4eda-4616-b10f-13b39f479375 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:29.404133 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-40f21e7e-d614-430c-b1c8-044cf61c8af3 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:29.404647 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-40f21e7e-d614-430c-b1c8-044cf61c8af3 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: ce2cd056-b2f1-43fb-a60a-323039d15162] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:29.414782 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-40f21e7e-d614-430c-b1c8-044cf61c8af3 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:29.415228 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-40f21e7e-d614-430c-b1c8-044cf61c8af3 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:29.415994 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-40f21e7e-d614-430c-b1c8-044cf61c8af3 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:29.416427 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-40f21e7e-d614-430c-b1c8-044cf61c8af3 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:29.449869 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-6809d771-9480-40f9-865a-04099e19bb16 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:29.451103 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-6809d771-9480-40f9-865a-04099e19bb16 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: bbe72f52-c8f9-46ea-ae59-9d2fe0a49523] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:29.460484 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-6809d771-9480-40f9-865a-04099e19bb16 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:29.460948 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-6809d771-9480-40f9-865a-04099e19bb16 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:29.461756 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-6809d771-9480-40f9-865a-04099e19bb16 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:29.462186 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-6809d771-9480-40f9-865a-04099e19bb16 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:29.598661 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-40f21e7e-d614-430c-b1c8-044cf61c8af3 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:29.606056 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-40f21e7e-d614-430c-b1c8-044cf61c8af3 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162" status: 200 len: 1366 microversion: 2.1 time: 0.205929 May 23 15:43:29.606623 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 119/251] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:29 2022] GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162 => generated 1366 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:29.629418 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-6809d771-9480-40f9-865a-04099e19bb16 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:29.629898 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-b9f0c707-f053-4cc3-9ec5-7d0798637126 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:29.630655 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-b9f0c707-f053-4cc3-9ec5-7d0798637126 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] [instance: 450d3441-4eda-4616-b10f-13b39f479375] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:29.636781 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b9f0c707-f053-4cc3-9ec5-7d0798637126 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:29.636952 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-6809d771-9480-40f9-865a-04099e19bb16 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523" status: 200 len: 1519 microversion: 2.1 time: 0.191037 May 23 15:43:29.637406 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b9f0c707-f053-4cc3-9ec5-7d0798637126 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:29.637516 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 133/252] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:29 2022] GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523 => generated 1519 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:43:29.638173 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b9f0c707-f053-4cc3-9ec5-7d0798637126 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:29.638613 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b9f0c707-f053-4cc3-9ec5-7d0798637126 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:29.769398 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-b9f0c707-f053-4cc3-9ec5-7d0798637126 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6badcf8b92dc43a3bc2342e303dec1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ef57ea448a49d3af268a02f6f08257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:29.772806 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_cell1:SELECT=100 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:43:29.777006 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-b9f0c707-f053-4cc3-9ec5-7d0798637126 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] 10.222.0.64 "GET /compute/v2.1/servers/450d3441-4eda-4616-b10f-13b39f479375" status: 200 len: 1313 microversion: 2.1 time: 0.151956 May 23 15:43:29.777595 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 120/253] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:29 2022] GET /compute/v2.1/servers/450d3441-4eda-4616-b10f-13b39f479375 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:30.623563 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-999b8c8b-f73f-4b88-ab3a-648336210528 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:30.624200 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-999b8c8b-f73f-4b88-ab3a-648336210528 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: ce2cd056-b2f1-43fb-a60a-323039d15162] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:30.631356 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-999b8c8b-f73f-4b88-ab3a-648336210528 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:30.635051 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-999b8c8b-f73f-4b88-ab3a-648336210528 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:30.635051 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-999b8c8b-f73f-4b88-ab3a-648336210528 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:30.635051 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-999b8c8b-f73f-4b88-ab3a-648336210528 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:30.654617 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-c505cacf-a1f3-49f2-93d1-9473133969da tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:30.655235 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-c505cacf-a1f3-49f2-93d1-9473133969da tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: bbe72f52-c8f9-46ea-ae59-9d2fe0a49523] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:30.662593 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c505cacf-a1f3-49f2-93d1-9473133969da tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:30.663053 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c505cacf-a1f3-49f2-93d1-9473133969da tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:30.663985 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c505cacf-a1f3-49f2-93d1-9473133969da tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:30.664269 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c505cacf-a1f3-49f2-93d1-9473133969da tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:30.856208 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-999b8c8b-f73f-4b88-ab3a-648336210528 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:30.867253 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-999b8c8b-f73f-4b88-ab3a-648336210528 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162" status: 200 len: 1366 microversion: 2.1 time: 0.247595 May 23 15:43:30.877385 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 134/254] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:30 2022] GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162 => generated 1366 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:30.882483 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-3e4d9375-ed2f-427a-851b-802ba8d85e47 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:30.883305 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-3e4d9375-ed2f-427a-851b-802ba8d85e47 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] [instance: 450d3441-4eda-4616-b10f-13b39f479375] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:30.885410 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-c505cacf-a1f3-49f2-93d1-9473133969da tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:30.889429 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3e4d9375-ed2f-427a-851b-802ba8d85e47 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:30.889885 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3e4d9375-ed2f-427a-851b-802ba8d85e47 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:30.890663 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3e4d9375-ed2f-427a-851b-802ba8d85e47 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:30.891100 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3e4d9375-ed2f-427a-851b-802ba8d85e47 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:30.893830 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-c505cacf-a1f3-49f2-93d1-9473133969da tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523" status: 200 len: 1519 microversion: 2.1 time: 0.243070 May 23 15:43:30.894405 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 121/255] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:30 2022] GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523 => generated 1519 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:43:31.012767 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-b28ac17c-7083-4de7-8937-185afbb75ffb tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "17620297-ecaa-4407-9cc4-87cfaeefc822"}} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:43:31.014283 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-b28ac17c-7083-4de7-8937-185afbb75ffb tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:31.020765 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b28ac17c-7083-4de7-8937-185afbb75ffb tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:31.021250 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b28ac17c-7083-4de7-8937-185afbb75ffb tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:31.022017 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b28ac17c-7083-4de7-8937-185afbb75ffb tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:31.022449 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b28ac17c-7083-4de7-8937-185afbb75ffb tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:31.033979 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-3e4d9375-ed2f-427a-851b-802ba8d85e47 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6badcf8b92dc43a3bc2342e303dec1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ef57ea448a49d3af268a02f6f08257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:31.041974 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-3e4d9375-ed2f-427a-851b-802ba8d85e47 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] 10.222.0.64 "GET /compute/v2.1/servers/450d3441-4eda-4616-b10f-13b39f479375" status: 200 len: 1313 microversion: 2.1 time: 0.163344 May 23 15:43:31.042619 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 135/256] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:30 2022] GET /compute/v2.1/servers/450d3441-4eda-4616-b10f-13b39f479375 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:31.885051 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-7718a231-f371-4a7d-bd02-1ff5d14f7c62 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:31.885721 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-7718a231-f371-4a7d-bd02-1ff5d14f7c62 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: ce2cd056-b2f1-43fb-a60a-323039d15162] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:31.891675 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-7718a231-f371-4a7d-bd02-1ff5d14f7c62 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:31.892102 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-7718a231-f371-4a7d-bd02-1ff5d14f7c62 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:31.892876 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-7718a231-f371-4a7d-bd02-1ff5d14f7c62 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:31.893922 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-7718a231-f371-4a7d-bd02-1ff5d14f7c62 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:32.019714 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-7718a231-f371-4a7d-bd02-1ff5d14f7c62 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:32.027134 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-7718a231-f371-4a7d-bd02-1ff5d14f7c62 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162" status: 200 len: 1366 microversion: 2.1 time: 0.146227 May 23 15:43:32.027747 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 136/257] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:31 2022] GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:43:32.032046 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-a58fc079-01d5-4c92-8517-f2b9e0b8b860 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:32.032651 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-a58fc079-01d5-4c92-8517-f2b9e0b8b860 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: bbe72f52-c8f9-46ea-ae59-9d2fe0a49523] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:32.039161 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-a58fc079-01d5-4c92-8517-f2b9e0b8b860 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:32.039627 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-a58fc079-01d5-4c92-8517-f2b9e0b8b860 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:32.040443 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-a58fc079-01d5-4c92-8517-f2b9e0b8b860 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:32.040892 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-a58fc079-01d5-4c92-8517-f2b9e0b8b860 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:32.176305 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-a58fc079-01d5-4c92-8517-f2b9e0b8b860 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:32.179701 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_cell1:SELECT=100 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:43:32.183964 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-a58fc079-01d5-4c92-8517-f2b9e0b8b860 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523" status: 200 len: 1519 microversion: 2.1 time: 0.155291 May 23 15:43:32.184520 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 137/258] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:32 2022] GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:32.188829 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-0e4d8333-023d-4865-8255-9671c66f76ff tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:32.189452 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-0e4d8333-023d-4865-8255-9671c66f76ff tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] [instance: 450d3441-4eda-4616-b10f-13b39f479375] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:32.195809 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0e4d8333-023d-4865-8255-9671c66f76ff tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:32.196258 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0e4d8333-023d-4865-8255-9671c66f76ff tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:32.197085 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0e4d8333-023d-4865-8255-9671c66f76ff tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:32.197508 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0e4d8333-023d-4865-8255-9671c66f76ff tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:32.325832 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-0e4d8333-023d-4865-8255-9671c66f76ff tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6badcf8b92dc43a3bc2342e303dec1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ef57ea448a49d3af268a02f6f08257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:32.333840 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-0e4d8333-023d-4865-8255-9671c66f76ff tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] 10.222.0.64 "GET /compute/v2.1/servers/450d3441-4eda-4616-b10f-13b39f479375" status: 200 len: 1497 microversion: 2.1 time: 0.148354 May 23 15:43:32.334407 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 138/259] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:32 2022] GET /compute/v2.1/servers/450d3441-4eda-4616-b10f-13b39f479375 => generated 1497 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:33.044787 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-bd2c12d7-e42a-43bc-b20b-8f748e0ef367 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:33.045675 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-bd2c12d7-e42a-43bc-b20b-8f748e0ef367 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: ce2cd056-b2f1-43fb-a60a-323039d15162] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:33.052296 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-bd2c12d7-e42a-43bc-b20b-8f748e0ef367 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:33.052749 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-bd2c12d7-e42a-43bc-b20b-8f748e0ef367 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:33.053553 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-bd2c12d7-e42a-43bc-b20b-8f748e0ef367 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:33.053993 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-bd2c12d7-e42a-43bc-b20b-8f748e0ef367 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:33.189529 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-bd2c12d7-e42a-43bc-b20b-8f748e0ef367 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:33.197672 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-bd2c12d7-e42a-43bc-b20b-8f748e0ef367 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162" status: 200 len: 1366 microversion: 2.1 time: 0.156679 May 23 15:43:33.198233 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 139/260] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:33 2022] GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:43:33.202681 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-34fd8ff9-9251-42a1-884d-333153bb3444 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:33.203226 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-34fd8ff9-9251-42a1-884d-333153bb3444 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: bbe72f52-c8f9-46ea-ae59-9d2fe0a49523] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:33.208834 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-34fd8ff9-9251-42a1-884d-333153bb3444 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:33.209327 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-34fd8ff9-9251-42a1-884d-333153bb3444 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:33.210106 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-34fd8ff9-9251-42a1-884d-333153bb3444 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:33.210554 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-34fd8ff9-9251-42a1-884d-333153bb3444 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:33.340655 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-34fd8ff9-9251-42a1-884d-333153bb3444 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:33.348502 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-34fd8ff9-9251-42a1-884d-333153bb3444 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523" status: 200 len: 1519 microversion: 2.1 time: 0.149338 May 23 15:43:33.349066 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 140/261] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:33 2022] GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523 => generated 1519 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:34.214096 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-fb97cea6-3e8c-4257-8900-6db84a49a390 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:34.214731 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-fb97cea6-3e8c-4257-8900-6db84a49a390 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: ce2cd056-b2f1-43fb-a60a-323039d15162] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:34.220582 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-fb97cea6-3e8c-4257-8900-6db84a49a390 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:34.221094 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-fb97cea6-3e8c-4257-8900-6db84a49a390 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:34.222507 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-fb97cea6-3e8c-4257-8900-6db84a49a390 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:34.222936 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-fb97cea6-3e8c-4257-8900-6db84a49a390 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:34.350445 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-fb97cea6-3e8c-4257-8900-6db84a49a390 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:34.357912 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-fb97cea6-3e8c-4257-8900-6db84a49a390 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162" status: 200 len: 1366 microversion: 2.1 time: 0.147648 May 23 15:43:34.358480 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 141/262] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:34 2022] GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:43:34.364710 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-0c8a06ba-ac24-4f53-ad1e-95ecbe1bba86 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:34.366563 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-0c8a06ba-ac24-4f53-ad1e-95ecbe1bba86 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: bbe72f52-c8f9-46ea-ae59-9d2fe0a49523] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:34.371338 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0c8a06ba-ac24-4f53-ad1e-95ecbe1bba86 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:34.371816 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0c8a06ba-ac24-4f53-ad1e-95ecbe1bba86 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:34.372578 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0c8a06ba-ac24-4f53-ad1e-95ecbe1bba86 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:34.373017 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0c8a06ba-ac24-4f53-ad1e-95ecbe1bba86 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:34.602065 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-0c8a06ba-ac24-4f53-ad1e-95ecbe1bba86 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:34.612031 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-0c8a06ba-ac24-4f53-ad1e-95ecbe1bba86 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523" status: 200 len: 1519 microversion: 2.1 time: 0.251090 May 23 15:43:34.616977 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 142/263] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:34 2022] GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523 => generated 1519 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:43:34.954895 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-b28ac17c-7083-4de7-8937-185afbb75ffb tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "POST /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.946039 May 23 15:43:34.957111 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 122/264] 10.222.0.64 () {60 vars in 1322 bytes} [Mon May 23 15:43:31 2022] POST /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358/os-volume_attachments => generated 194 bytes in 3949 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:43:35.374534 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-f023587c-f02a-4d6e-96a0-66f7b65d5c59 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:35.375149 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-f023587c-f02a-4d6e-96a0-66f7b65d5c59 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: ce2cd056-b2f1-43fb-a60a-323039d15162] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:35.381575 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-f023587c-f02a-4d6e-96a0-66f7b65d5c59 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:35.382030 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-f023587c-f02a-4d6e-96a0-66f7b65d5c59 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:35.382926 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-f023587c-f02a-4d6e-96a0-66f7b65d5c59 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:35.383487 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-f023587c-f02a-4d6e-96a0-66f7b65d5c59 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:35.520939 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-f023587c-f02a-4d6e-96a0-66f7b65d5c59 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:35.528428 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-f023587c-f02a-4d6e-96a0-66f7b65d5c59 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162" status: 200 len: 1366 microversion: 2.1 time: 0.157952 May 23 15:43:35.528997 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 143/265] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:35 2022] GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:35.630573 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-56148c59-35a4-42a5-94cf-62d133e1c47a tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:35.631267 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-56148c59-35a4-42a5-94cf-62d133e1c47a tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: bbe72f52-c8f9-46ea-ae59-9d2fe0a49523] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:35.638966 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-56148c59-35a4-42a5-94cf-62d133e1c47a tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:35.639574 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-56148c59-35a4-42a5-94cf-62d133e1c47a tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:35.640541 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-56148c59-35a4-42a5-94cf-62d133e1c47a tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:35.641036 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-56148c59-35a4-42a5-94cf-62d133e1c47a tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:35.784735 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-56148c59-35a4-42a5-94cf-62d133e1c47a tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:35.792350 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-56148c59-35a4-42a5-94cf-62d133e1c47a tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523" status: 200 len: 1519 microversion: 2.1 time: 0.166705 May 23 15:43:35.792912 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 123/266] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:35 2022] GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523 => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:35.995766 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-94e0a18e-44b5-4330-984f-e6ecb6d4a37c tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:35.996376 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-94e0a18e-44b5-4330-984f-e6ecb6d4a37c tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] [instance: 450d3441-4eda-4616-b10f-13b39f479375] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:36.004121 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-94e0a18e-44b5-4330-984f-e6ecb6d4a37c tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:36.004685 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-94e0a18e-44b5-4330-984f-e6ecb6d4a37c tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:36.005708 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-94e0a18e-44b5-4330-984f-e6ecb6d4a37c tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:36.006263 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-94e0a18e-44b5-4330-984f-e6ecb6d4a37c tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:36.037300 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-94e0a18e-44b5-4330-984f-e6ecb6d4a37c tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] [instance: 450d3441-4eda-4616-b10f-13b39f479375] Going to try to terminate instance {{(pid=124934) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 15:43:36.340338 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-94e0a18e-44b5-4330-984f-e6ecb6d4a37c tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] 10.222.0.64 "DELETE /compute/v2.1/servers/450d3441-4eda-4616-b10f-13b39f479375" status: 204 len: 0 microversion: 2.1 time: 0.348418 May 23 15:43:36.340991 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 144/267] 10.222.0.64 () {58 vars in 1238 bytes} [Mon May 23 15:43:35 2022] DELETE /compute/v2.1/servers/450d3441-4eda-4616-b10f-13b39f479375 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 23 15:43:36.350753 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-61d5fb51-8adf-4925-90cb-93c7769dbbda tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:36.351461 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-61d5fb51-8adf-4925-90cb-93c7769dbbda tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] [instance: 450d3441-4eda-4616-b10f-13b39f479375] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:36.358617 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-61d5fb51-8adf-4925-90cb-93c7769dbbda tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:36.359082 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-61d5fb51-8adf-4925-90cb-93c7769dbbda tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:36.359935 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-61d5fb51-8adf-4925-90cb-93c7769dbbda tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:36.360388 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-61d5fb51-8adf-4925-90cb-93c7769dbbda tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:36.523859 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-61d5fb51-8adf-4925-90cb-93c7769dbbda tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6badcf8b92dc43a3bc2342e303dec1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ef57ea448a49d3af268a02f6f08257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:36.532103 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-61d5fb51-8adf-4925-90cb-93c7769dbbda tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] 10.222.0.64 "GET /compute/v2.1/servers/450d3441-4eda-4616-b10f-13b39f479375" status: 200 len: 1503 microversion: 2.1 time: 0.185541 May 23 15:43:36.532672 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 124/268] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:36 2022] GET /compute/v2.1/servers/450d3441-4eda-4616-b10f-13b39f479375 => generated 1503 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:36.546612 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-529956a8-0619-4400-9e62-a0da5732466d tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:36.547326 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-529956a8-0619-4400-9e62-a0da5732466d tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: ce2cd056-b2f1-43fb-a60a-323039d15162] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:36.554107 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-529956a8-0619-4400-9e62-a0da5732466d tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:36.554556 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-529956a8-0619-4400-9e62-a0da5732466d tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:36.555334 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-529956a8-0619-4400-9e62-a0da5732466d tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:36.555780 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-529956a8-0619-4400-9e62-a0da5732466d tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:36.694405 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-529956a8-0619-4400-9e62-a0da5732466d tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:36.706651 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-529956a8-0619-4400-9e62-a0da5732466d tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162" status: 200 len: 1366 microversion: 2.1 time: 0.163604 May 23 15:43:36.715955 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 145/269] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:36 2022] GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162 => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:36.809621 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-79bbf948-2555-45f0-8cd9-88db20e3b259 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:36.810195 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-79bbf948-2555-45f0-8cd9-88db20e3b259 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: bbe72f52-c8f9-46ea-ae59-9d2fe0a49523] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:36.816283 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-79bbf948-2555-45f0-8cd9-88db20e3b259 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:36.816744 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-79bbf948-2555-45f0-8cd9-88db20e3b259 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:36.817589 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-79bbf948-2555-45f0-8cd9-88db20e3b259 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:36.818040 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-79bbf948-2555-45f0-8cd9-88db20e3b259 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:36.966029 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-79bbf948-2555-45f0-8cd9-88db20e3b259 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:36.975160 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-79bbf948-2555-45f0-8cd9-88db20e3b259 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523" status: 200 len: 1519 microversion: 2.1 time: 0.169379 May 23 15:43:36.975831 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 125/270] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:36 2022] GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523 => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:37.551074 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-05f50140-9616-4910-9dd5-018b6e7b2be2 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:37.551699 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-05f50140-9616-4910-9dd5-018b6e7b2be2 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] [instance: 450d3441-4eda-4616-b10f-13b39f479375] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:37.557828 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-05f50140-9616-4910-9dd5-018b6e7b2be2 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:37.560378 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-05f50140-9616-4910-9dd5-018b6e7b2be2 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:37.560378 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-05f50140-9616-4910-9dd5-018b6e7b2be2 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:37.560378 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-05f50140-9616-4910-9dd5-018b6e7b2be2 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:37.704371 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-05f50140-9616-4910-9dd5-018b6e7b2be2 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6badcf8b92dc43a3bc2342e303dec1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ef57ea448a49d3af268a02f6f08257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:37.712747 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-05f50140-9616-4910-9dd5-018b6e7b2be2 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] 10.222.0.64 "GET /compute/v2.1/servers/450d3441-4eda-4616-b10f-13b39f479375" status: 200 len: 1503 microversion: 2.1 time: 0.166207 May 23 15:43:37.713551 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 146/271] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:37 2022] GET /compute/v2.1/servers/450d3441-4eda-4616-b10f-13b39f479375 => generated 1503 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:37.724813 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-16ba1b09-0f50-43af-8edb-2a32a58797a7 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:37.725760 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-16ba1b09-0f50-43af-8edb-2a32a58797a7 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: ce2cd056-b2f1-43fb-a60a-323039d15162] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:37.732991 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-16ba1b09-0f50-43af-8edb-2a32a58797a7 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:37.733700 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-16ba1b09-0f50-43af-8edb-2a32a58797a7 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:37.734676 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-16ba1b09-0f50-43af-8edb-2a32a58797a7 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:37.735262 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-16ba1b09-0f50-43af-8edb-2a32a58797a7 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:37.876215 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-16ba1b09-0f50-43af-8edb-2a32a58797a7 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:37.890738 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-16ba1b09-0f50-43af-8edb-2a32a58797a7 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162" status: 200 len: 1366 microversion: 2.1 time: 0.171213 May 23 15:43:37.891379 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 126/272] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:37 2022] GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:37.993625 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-414ec684-9f71-4357-b98d-a81b293bd406 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:37.994299 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-414ec684-9f71-4357-b98d-a81b293bd406 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: bbe72f52-c8f9-46ea-ae59-9d2fe0a49523] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:38.000924 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-414ec684-9f71-4357-b98d-a81b293bd406 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:38.001423 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-414ec684-9f71-4357-b98d-a81b293bd406 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:38.005753 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-414ec684-9f71-4357-b98d-a81b293bd406 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:38.005753 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-414ec684-9f71-4357-b98d-a81b293bd406 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:38.179811 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-414ec684-9f71-4357-b98d-a81b293bd406 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:38.187673 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-414ec684-9f71-4357-b98d-a81b293bd406 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523" status: 200 len: 1519 microversion: 2.1 time: 0.198175 May 23 15:43:38.188443 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 147/273] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:37 2022] GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523 => generated 1519 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:38.730391 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-81e173f5-d565-41ae-9ab4-5bf01d3efa0d tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:38.731010 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-81e173f5-d565-41ae-9ab4-5bf01d3efa0d tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] [instance: 450d3441-4eda-4616-b10f-13b39f479375] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:38.738188 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-81e173f5-d565-41ae-9ab4-5bf01d3efa0d tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:38.738642 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-81e173f5-d565-41ae-9ab4-5bf01d3efa0d tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:38.739415 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-81e173f5-d565-41ae-9ab4-5bf01d3efa0d tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:38.739858 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-81e173f5-d565-41ae-9ab4-5bf01d3efa0d tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:38.855589 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-81e173f5-d565-41ae-9ab4-5bf01d3efa0d tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6badcf8b92dc43a3bc2342e303dec1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ef57ea448a49d3af268a02f6f08257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:38.869405 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-81e173f5-d565-41ae-9ab4-5bf01d3efa0d tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] 10.222.0.64 "GET /compute/v2.1/servers/450d3441-4eda-4616-b10f-13b39f479375" status: 200 len: 1461 microversion: 2.1 time: 0.142783 May 23 15:43:38.870130 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 127/274] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:38 2022] GET /compute/v2.1/servers/450d3441-4eda-4616-b10f-13b39f479375 => generated 1461 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:38.904882 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [req-83e5d703-4d63-4cda-8edf-f717baf81545 req-57375b67-3a76-4e9a-9a0e-dda4bd41ded2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "450d3441-4eda-4616-b10f-13b39f479375", "name": "network-vif-deleted", "tag": "bbd71d32-cefe-4efd-a0d5-f2682da7cef4"}]} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:43:38.907402 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-8139aa59-2409-44dc-b118-09145391d2c0 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:38.908043 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-8139aa59-2409-44dc-b118-09145391d2c0 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: ce2cd056-b2f1-43fb-a60a-323039d15162] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:38.916560 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-8139aa59-2409-44dc-b118-09145391d2c0 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:38.916560 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-8139aa59-2409-44dc-b118-09145391d2c0 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:38.916560 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-8139aa59-2409-44dc-b118-09145391d2c0 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:38.916823 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-8139aa59-2409-44dc-b118-09145391d2c0 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:38.931863 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:43:38.933927 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-83e5d703-4d63-4cda-8edf-f717baf81545 req-57375b67-3a76-4e9a-9a0e-dda4bd41ded2 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:38.934369 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-83e5d703-4d63-4cda-8edf-f717baf81545 req-57375b67-3a76-4e9a-9a0e-dda4bd41ded2 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:38.958214 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.compute.server_external_events [req-83e5d703-4d63-4cda-8edf-f717baf81545 req-57375b67-3a76-4e9a-9a0e-dda4bd41ded2 service nova] Creating event network-vif-deleted:bbd71d32-cefe-4efd-a0d5-f2682da7cef4 for instance 450d3441-4eda-4616-b10f-13b39f479375 on hv-cinder-84067 May 23 15:43:38.974440 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [req-83e5d703-4d63-4cda-8edf-f717baf81545 req-57375b67-3a76-4e9a-9a0e-dda4bd41ded2 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073757 May 23 15:43:38.975189 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 148/275] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:43:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:43:39.073280 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-8139aa59-2409-44dc-b118-09145391d2c0 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:39.080443 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-8139aa59-2409-44dc-b118-09145391d2c0 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162" status: 200 len: 1366 microversion: 2.1 time: 0.176766 May 23 15:43:39.081861 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 128/276] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:38 2022] GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162 => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:43:39.209000 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-5f8e813c-4be9-4118-8d3c-3ea1f0f17e99 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:39.209824 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-5f8e813c-4be9-4118-8d3c-3ea1f0f17e99 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: bbe72f52-c8f9-46ea-ae59-9d2fe0a49523] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:39.217087 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5f8e813c-4be9-4118-8d3c-3ea1f0f17e99 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:39.217695 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5f8e813c-4be9-4118-8d3c-3ea1f0f17e99 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:39.218488 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5f8e813c-4be9-4118-8d3c-3ea1f0f17e99 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:39.218932 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5f8e813c-4be9-4118-8d3c-3ea1f0f17e99 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:39.377270 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-5f8e813c-4be9-4118-8d3c-3ea1f0f17e99 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:39.385296 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-5f8e813c-4be9-4118-8d3c-3ea1f0f17e99 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523" status: 200 len: 1519 microversion: 2.1 time: 0.182772 May 23 15:43:39.386082 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 149/277] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:39 2022] GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523 => generated 1519 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:39.706398 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [req-434050b7-e780-4089-b86a-1f5cc6c7e993 req-1277359b-d391-4cf2-8007-a96f7a2d6da5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce2cd056-b2f1-43fb-a60a-323039d15162", "name": "network-vif-plugged", "status": "completed", "tag": "cefdd54f-7186-4994-802f-370961a2ffcb"}]} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:43:39.715406 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-434050b7-e780-4089-b86a-1f5cc6c7e993 req-1277359b-d391-4cf2-8007-a96f7a2d6da5 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:39.715861 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-434050b7-e780-4089-b86a-1f5cc6c7e993 req-1277359b-d391-4cf2-8007-a96f7a2d6da5 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:39.729607 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.compute.server_external_events [req-434050b7-e780-4089-b86a-1f5cc6c7e993 req-1277359b-d391-4cf2-8007-a96f7a2d6da5 service nova] Creating event network-vif-plugged:cefdd54f-7186-4994-802f-370961a2ffcb for instance ce2cd056-b2f1-43fb-a60a-323039d15162 on hv-cinder-84067 May 23 15:43:39.734365 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [req-434050b7-e780-4089-b86a-1f5cc6c7e993 req-1277359b-d391-4cf2-8007-a96f7a2d6da5 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033961 May 23 15:43:39.738106 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 129/278] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:43:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:43:39.886470 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-ce9b4d45-ea48-43c8-96e6-5597c3d57aea tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:39.887075 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-ce9b4d45-ea48-43c8-96e6-5597c3d57aea tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] [instance: 450d3441-4eda-4616-b10f-13b39f479375] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:39.893816 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ce9b4d45-ea48-43c8-96e6-5597c3d57aea tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:39.894271 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ce9b4d45-ea48-43c8-96e6-5597c3d57aea tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:39.895172 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ce9b4d45-ea48-43c8-96e6-5597c3d57aea tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:39.895613 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ce9b4d45-ea48-43c8-96e6-5597c3d57aea tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:39.930650 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ce9b4d45-ea48-43c8-96e6-5597c3d57aea tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:39.936131 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ce9b4d45-ea48-43c8-96e6-5597c3d57aea tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:39.936131 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.objects.instance [None req-ce9b4d45-ea48-43c8-96e6-5597c3d57aea tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lazy-loading 'fault' on Instance uuid 450d3441-4eda-4616-b10f-13b39f479375 {{(pid=124934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 15:43:39.985091 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-ce9b4d45-ea48-43c8-96e6-5597c3d57aea tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6badcf8b92dc43a3bc2342e303dec1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ef57ea448a49d3af268a02f6f08257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:39.992701 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-ce9b4d45-ea48-43c8-96e6-5597c3d57aea tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] 10.222.0.64 "GET /compute/v2.1/servers/450d3441-4eda-4616-b10f-13b39f479375" status: 200 len: 1303 microversion: 2.1 time: 0.109982 May 23 15:43:39.993346 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 150/279] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:39 2022] GET /compute/v2.1/servers/450d3441-4eda-4616-b10f-13b39f479375 => generated 1303 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:40.099300 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-845491a6-7a59-4639-8821-c1b930a0dcea tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:40.099999 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-845491a6-7a59-4639-8821-c1b930a0dcea tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: ce2cd056-b2f1-43fb-a60a-323039d15162] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:40.108223 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-845491a6-7a59-4639-8821-c1b930a0dcea tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:40.108223 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-845491a6-7a59-4639-8821-c1b930a0dcea tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:40.108223 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-845491a6-7a59-4639-8821-c1b930a0dcea tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:40.108223 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-845491a6-7a59-4639-8821-c1b930a0dcea tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:40.283199 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-845491a6-7a59-4639-8821-c1b930a0dcea tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:40.292214 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-845491a6-7a59-4639-8821-c1b930a0dcea tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162" status: 200 len: 1366 microversion: 2.1 time: 0.198567 May 23 15:43:40.292962 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 130/280] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:40 2022] GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162 => generated 1366 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:40.402747 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-ecbd6052-487c-41fe-83b4-663f9a8f27a9 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:40.403425 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-ecbd6052-487c-41fe-83b4-663f9a8f27a9 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: bbe72f52-c8f9-46ea-ae59-9d2fe0a49523] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:40.410647 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ecbd6052-487c-41fe-83b4-663f9a8f27a9 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:40.411108 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ecbd6052-487c-41fe-83b4-663f9a8f27a9 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:40.411877 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ecbd6052-487c-41fe-83b4-663f9a8f27a9 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:40.412316 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ecbd6052-487c-41fe-83b4-663f9a8f27a9 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:40.551566 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-ecbd6052-487c-41fe-83b4-663f9a8f27a9 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:40.559248 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-ecbd6052-487c-41fe-83b4-663f9a8f27a9 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523" status: 200 len: 1519 microversion: 2.1 time: 0.160267 May 23 15:43:40.559811 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 151/281] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:40 2022] GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:41.009812 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-1942f720-4984-4f08-a3fd-30ac9edcdad8 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:41.010432 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-1942f720-4984-4f08-a3fd-30ac9edcdad8 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] [instance: 450d3441-4eda-4616-b10f-13b39f479375] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:41.016358 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1942f720-4984-4f08-a3fd-30ac9edcdad8 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:41.016812 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1942f720-4984-4f08-a3fd-30ac9edcdad8 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:41.017627 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1942f720-4984-4f08-a3fd-30ac9edcdad8 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:41.018627 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1942f720-4984-4f08-a3fd-30ac9edcdad8 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:41.032535 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.wsgi [None req-1942f720-4984-4f08-a3fd-30ac9edcdad8 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] HTTP exception thrown: Instance 450d3441-4eda-4616-b10f-13b39f479375 could not be found. May 23 15:43:41.035126 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-1942f720-4984-4f08-a3fd-30ac9edcdad8 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Request method failure captured: May 23 15:43:41.035126 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: request: GET /compute/v2.1/servers/450d3441-4eda-4616-b10f-13b39f479375 HTTP/1.1 May 23 15:43:41.035126 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Accept: application/json May 23 15:43:41.035126 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Accept-Encoding: identity May 23 15:43:41.035126 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Connection: close May 23 15:43:41.035126 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Content-Length: 0 May 23 15:43:41.035126 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Content-Type: application/json May 23 15:43:41.035126 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Host: 10.222.0.64 May 23 15:43:41.035126 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Openstack-System-Scope: None May 23 15:43:41.035126 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: User-Agent: python-urllib3/1.26.9 May 23 15:43:41.035126 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Auth-Token: gAAAAABii6uDsutXsIwiNt9SPQqqH1l82E8ePlgUe0Qkm9sMiKd-vuz-StQSVSZndc2fusuMjXt62MEW5Pv0PU3h2-dAc5_3VbnfHMKn2GVD_Ju47SnE7GArntQHKSGiubSoNIjIAmLDRbh8BjhT_0oDvCfA69PFaUQIdBY9n-saIXQwjhUILGo May 23 15:43:41.035126 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Domain-Id: None May 23 15:43:41.035126 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Domain-Name: None May 23 15:43:41.035126 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Identity-Status: Confirmed May 23 15:43:41.035126 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Is-Admin-Project: True May 23 15:43:41.035126 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Domain-Id: default May 23 15:43:41.035126 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Domain-Name: Default May 23 15:43:41.035126 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Id: c2ef57ea448a49d3af268a02f6f08257 May 23 15:43:41.035126 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Name: tempest-VolumesActionsTest-2033716942 May 23 15:43:41.035126 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Role: reader,member May 23 15:43:41.035126 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Roles: reader,member May 23 15:43:41.036563 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/c2ef57ea448a49d3af268a02f6f08257"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/c2ef57ea448a49d3af268a02f6f08257"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/c2ef57ea448a49d3af268a02f6f08257"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_c2ef57ea448a49d3af268a02f6f08257", "adminURL": "http://10.222.0.64:8080"}]}] May 23 15:43:41.036563 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant: tempest-VolumesActionsTest-2033716942 May 23 15:43:41.036563 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant-Id: c2ef57ea448a49d3af268a02f6f08257 May 23 15:43:41.036563 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant-Name: tempest-VolumesActionsTest-2033716942 May 23 15:43:41.036563 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User: tempest-VolumesActionsTest-2033716942-project May 23 15:43:41.036563 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Domain-Id: default May 23 15:43:41.036563 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Domain-Name: Default May 23 15:43:41.036563 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Id: 6badcf8b92dc43a3bc2342e303dec1da May 23 15:43:41.036563 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Name: tempest-VolumesActionsTest-2033716942-project May 23 15:43:41.036563 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: method: > May 23 15:43:41.036563 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: exception: Instance 450d3441-4eda-4616-b10f-13b39f479375 could not be found. May 23 15:43:41.036563 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: action_args: {'id': '450d3441-4eda-4616-b10f-13b39f479375'} May 23 15:43:41.037453 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:43:41.037453 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:43:41.037453 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:43:41.037453 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:43:41.037453 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:43:41.037453 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:43:41.037453 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:43:41.037453 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:43:41.037453 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:43:41.037453 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:43:41.037453 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 450d3441-4eda-4616-b10f-13b39f479375 could not be found. May 23 15:43:41.037453 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:43:41.037453 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:43:41.037453 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:43:41.037453 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:43:41.037453 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:43:41.037453 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:43:41.037453 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:43:41.037453 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:43:41.037453 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:43:41.038815 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:43:41.038815 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 15:43:41.038815 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 15:43:41.038815 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:43:41.038815 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:43:41.038815 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:43:41.038815 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:43:41.038815 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 450d3441-4eda-4616-b10f-13b39f479375 could not be found. May 23 15:43:41.038815 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:43:41.038815 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:43:41.038815 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:43:41.038815 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:43:41.038815 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:43:41.038815 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:43:41.038815 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:43:41.038815 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:43:41.038815 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 450d3441-4eda-4616-b10f-13b39f479375 could not be found. May 23 15:43:41.038815 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:43:41.040183 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-1942f720-4984-4f08-a3fd-30ac9edcdad8 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Returning 404 to user: Instance 450d3441-4eda-4616-b10f-13b39f479375 could not be found. {{(pid=124933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:43:41.040183 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-1942f720-4984-4f08-a3fd-30ac9edcdad8 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] 10.222.0.64 "GET /compute/v2.1/servers/450d3441-4eda-4616-b10f-13b39f479375" status: 404 len: 111 microversion: 2.1 time: 0.030629 May 23 15:43:41.040183 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 131/282] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:41 2022] GET /compute/v2.1/servers/450d3441-4eda-4616-b10f-13b39f479375 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 15:43:41.134903 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-781f28cb-58f6-41d6-9894-db7256db724e tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-83282650", "imageRef": "a5c8503f-3733-426f-8a5b-c7c9358e4a45", "flavorRef": "452", "networks": [{"uuid": "1f7dcd01-712e-4910-801c-ec7cd2120c05"}]}} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:43:41.185932 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.network.neutron [None req-781f28cb-58f6-41d6-9894-db7256db724e tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] validate_networks() for [('1f7dcd01-712e-4910-801c-ec7cd2120c05', None, None, None, None, None)] {{(pid=124934) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 15:43:41.309173 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-50496518-1958-4bf8-b573-a5ce134fab96 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:41.309796 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-50496518-1958-4bf8-b573-a5ce134fab96 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: ce2cd056-b2f1-43fb-a60a-323039d15162] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:41.316759 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-50496518-1958-4bf8-b573-a5ce134fab96 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:41.317247 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-50496518-1958-4bf8-b573-a5ce134fab96 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:41.318023 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-50496518-1958-4bf8-b573-a5ce134fab96 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:41.318502 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-50496518-1958-4bf8-b573-a5ce134fab96 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:41.523952 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-50496518-1958-4bf8-b573-a5ce134fab96 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:41.532117 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-50496518-1958-4bf8-b573-a5ce134fab96 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162" status: 200 len: 1366 microversion: 2.1 time: 0.226732 May 23 15:43:41.532687 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 132/283] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:41 2022] GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162 => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:41.577674 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-dfedaca8-eb79-49d6-8d6e-b68d3376ee8d tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:41.578325 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-dfedaca8-eb79-49d6-8d6e-b68d3376ee8d tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: bbe72f52-c8f9-46ea-ae59-9d2fe0a49523] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:41.585304 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-dfedaca8-eb79-49d6-8d6e-b68d3376ee8d tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:41.585689 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-dfedaca8-eb79-49d6-8d6e-b68d3376ee8d tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:41.586505 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-dfedaca8-eb79-49d6-8d6e-b68d3376ee8d tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:41.586955 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-dfedaca8-eb79-49d6-8d6e-b68d3376ee8d tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:41.608408 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.virt.hardware [None req-781f28cb-58f6-41d6-9894-db7256db724e tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Flavor limits 0:0:0 {{(pid=124934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 15:43:41.608866 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.virt.hardware [None req-781f28cb-58f6-41d6-9894-db7256db724e tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Image limits 0:0:0 {{(pid=124934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 15:43:41.609416 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.virt.hardware [None req-781f28cb-58f6-41d6-9894-db7256db724e tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Flavor pref 0:0:0 {{(pid=124934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 15:43:41.609827 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.virt.hardware [None req-781f28cb-58f6-41d6-9894-db7256db724e tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Image pref 0:0:0 {{(pid=124934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 15:43:41.610263 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.virt.hardware [None req-781f28cb-58f6-41d6-9894-db7256db724e tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 15:43:41.620147 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-781f28cb-58f6-41d6-9894-db7256db724e tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:41.620916 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-781f28cb-58f6-41d6-9894-db7256db724e tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:41.621761 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-781f28cb-58f6-41d6-9894-db7256db724e tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:41.622208 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-781f28cb-58f6-41d6-9894-db7256db724e tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:41.641042 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.quota [None req-781f28cb-58f6-41d6-9894-db7256db724e tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Getting quotas for project c2ef57ea448a49d3af268a02f6f08257. Resources: {'ram', 'instances', 'cores'} {{(pid=124934) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 15:43:41.645409 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.quota [None req-781f28cb-58f6-41d6-9894-db7256db724e tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Getting quotas for user 6badcf8b92dc43a3bc2342e303dec1da and project c2ef57ea448a49d3af268a02f6f08257. Resources: {'ram', 'instances', 'cores'} {{(pid=124934) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 15:43:41.656840 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-781f28cb-58f6-41d6-9894-db7256db724e tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Going to run 1 instances... {{(pid=124934) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 15:43:41.660903 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-781f28cb-58f6-41d6-9894-db7256db724e tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] [instance: ef32fe68-b121-4fdf-874b-db3e366da292] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5c8503f-3733-426f-8a5b-c7c9358e4a45',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124934) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 15:43:41.734192 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-dfedaca8-eb79-49d6-8d6e-b68d3376ee8d tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:41.741950 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-dfedaca8-eb79-49d6-8d6e-b68d3376ee8d tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523" status: 200 len: 1519 microversion: 2.1 time: 0.168239 May 23 15:43:41.742551 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 133/284] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:41 2022] GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523 => generated 1519 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:43:41.776601 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-781f28cb-58f6-41d6-9894-db7256db724e tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.645793 May 23 15:43:41.777276 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 152/285] 10.222.0.64 () {60 vars in 1146 bytes} [Mon May 23 15:43:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 15:43:41.788017 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-fac21fd5-4221-41da-bb20-bc2da7897fed tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:41.788634 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-fac21fd5-4221-41da-bb20-bc2da7897fed tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] [instance: ef32fe68-b121-4fdf-874b-db3e366da292] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:41.855700 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-fac21fd5-4221-41da-bb20-bc2da7897fed tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6badcf8b92dc43a3bc2342e303dec1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ef57ea448a49d3af268a02f6f08257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:41.862745 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-fac21fd5-4221-41da-bb20-bc2da7897fed tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] 10.222.0.64 "GET /compute/v2.1/servers/ef32fe68-b121-4fdf-874b-db3e366da292" status: 200 len: 1212 microversion: 2.1 time: 0.079302 May 23 15:43:41.872642 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 134/286] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:41 2022] GET /compute/v2.1/servers/ef32fe68-b121-4fdf-874b-db3e366da292 => generated 1212 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:42.552008 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-7bf7572e-b27e-43a4-a153-c6b9142e276e tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:42.552876 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-7bf7572e-b27e-43a4-a153-c6b9142e276e tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: ce2cd056-b2f1-43fb-a60a-323039d15162] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:42.559525 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-7bf7572e-b27e-43a4-a153-c6b9142e276e tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:42.559987 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-7bf7572e-b27e-43a4-a153-c6b9142e276e tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:42.561036 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-7bf7572e-b27e-43a4-a153-c6b9142e276e tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:42.561515 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-7bf7572e-b27e-43a4-a153-c6b9142e276e tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:42.700715 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-7bf7572e-b27e-43a4-a153-c6b9142e276e tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:42.709124 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:43:42.711705 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-7bf7572e-b27e-43a4-a153-c6b9142e276e tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162" status: 200 len: 1366 microversion: 2.1 time: 0.166400 May 23 15:43:42.712394 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 153/287] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:42 2022] GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:42.759769 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-7afab161-89d2-4ef4-bf9d-fe9cc86f0fe2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:42.760495 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-7afab161-89d2-4ef4-bf9d-fe9cc86f0fe2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: bbe72f52-c8f9-46ea-ae59-9d2fe0a49523] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:42.767785 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-7afab161-89d2-4ef4-bf9d-fe9cc86f0fe2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:42.768268 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-7afab161-89d2-4ef4-bf9d-fe9cc86f0fe2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:42.769029 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-7afab161-89d2-4ef4-bf9d-fe9cc86f0fe2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:42.769490 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-7afab161-89d2-4ef4-bf9d-fe9cc86f0fe2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:42.879641 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-53bb4901-e188-4204-9212-c486a5381976 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:42.881190 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-53bb4901-e188-4204-9212-c486a5381976 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] [instance: ef32fe68-b121-4fdf-874b-db3e366da292] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:42.886978 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-53bb4901-e188-4204-9212-c486a5381976 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:42.887820 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-53bb4901-e188-4204-9212-c486a5381976 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:42.888829 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-53bb4901-e188-4204-9212-c486a5381976 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:42.889541 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-53bb4901-e188-4204-9212-c486a5381976 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:42.975940 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-53bb4901-e188-4204-9212-c486a5381976 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6badcf8b92dc43a3bc2342e303dec1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ef57ea448a49d3af268a02f6f08257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:42.981822 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-7afab161-89d2-4ef4-bf9d-fe9cc86f0fe2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:42.990877 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-7afab161-89d2-4ef4-bf9d-fe9cc86f0fe2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523" status: 200 len: 1519 microversion: 2.1 time: 0.235851 May 23 15:43:42.991461 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 135/288] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:42 2022] GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523 => generated 1519 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:42.998218 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-53bb4901-e188-4204-9212-c486a5381976 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] 10.222.0.64 "GET /compute/v2.1/servers/ef32fe68-b121-4fdf-874b-db3e366da292" status: 200 len: 1216 microversion: 2.1 time: 0.120501 May 23 15:43:42.999193 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 154/289] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:42 2022] GET /compute/v2.1/servers/ef32fe68-b121-4fdf-874b-db3e366da292 => generated 1216 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:43:43.730412 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-619cba03-fcb6-47b2-af80-aab719d61937 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:43.731238 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-619cba03-fcb6-47b2-af80-aab719d61937 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: ce2cd056-b2f1-43fb-a60a-323039d15162] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:43.744246 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-619cba03-fcb6-47b2-af80-aab719d61937 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:43.744573 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-619cba03-fcb6-47b2-af80-aab719d61937 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:43.745382 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-619cba03-fcb6-47b2-af80-aab719d61937 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:43.745819 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-619cba03-fcb6-47b2-af80-aab719d61937 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:43.889811 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-619cba03-fcb6-47b2-af80-aab719d61937 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:43.899444 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-619cba03-fcb6-47b2-af80-aab719d61937 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162" status: 200 len: 1556 microversion: 2.1 time: 0.173940 May 23 15:43:43.900673 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 136/290] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:43 2022] GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162 => generated 1556 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:43:43.917251 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-0464e6d9-7e30-4865-8911-ee7a0d5c7a27 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:43.917716 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-0464e6d9-7e30-4865-8911-ee7a0d5c7a27 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: ce2cd056-b2f1-43fb-a60a-323039d15162] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:43.929772 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0464e6d9-7e30-4865-8911-ee7a0d5c7a27 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:43.929772 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0464e6d9-7e30-4865-8911-ee7a0d5c7a27 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:43.929772 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0464e6d9-7e30-4865-8911-ee7a0d5c7a27 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:43.929772 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0464e6d9-7e30-4865-8911-ee7a0d5c7a27 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:44.014971 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-b26d1ace-e14b-48a2-8ac7-bf41aea409b2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:44.016635 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-b26d1ace-e14b-48a2-8ac7-bf41aea409b2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: bbe72f52-c8f9-46ea-ae59-9d2fe0a49523] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:44.021147 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-0464e6d9-7e30-4865-8911-ee7a0d5c7a27 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.108164 May 23 15:43:44.027769 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b26d1ace-e14b-48a2-8ac7-bf41aea409b2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:44.028475 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 155/291] 10.222.0.64 () {58 vars in 1274 bytes} [Mon May 23 15:43:43 2022] GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162/os-interface => generated 284 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:43:44.029496 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b26d1ace-e14b-48a2-8ac7-bf41aea409b2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:44.031035 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b26d1ace-e14b-48a2-8ac7-bf41aea409b2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:44.031491 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b26d1ace-e14b-48a2-8ac7-bf41aea409b2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:44.040990 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-f71b8c07-2eeb-4cce-9878-414f5329eaf4 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:44.041661 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-f71b8c07-2eeb-4cce-9878-414f5329eaf4 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] [instance: ef32fe68-b121-4fdf-874b-db3e366da292] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:44.051930 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-f71b8c07-2eeb-4cce-9878-414f5329eaf4 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:44.052393 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-f71b8c07-2eeb-4cce-9878-414f5329eaf4 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:44.053203 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-f71b8c07-2eeb-4cce-9878-414f5329eaf4 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:44.053650 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-f71b8c07-2eeb-4cce-9878-414f5329eaf4 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:44.142322 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-f71b8c07-2eeb-4cce-9878-414f5329eaf4 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6badcf8b92dc43a3bc2342e303dec1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ef57ea448a49d3af268a02f6f08257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:44.152873 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-f71b8c07-2eeb-4cce-9878-414f5329eaf4 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] 10.222.0.64 "GET /compute/v2.1/servers/ef32fe68-b121-4fdf-874b-db3e366da292" status: 200 len: 1208 microversion: 2.1 time: 0.120078 May 23 15:43:44.153496 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 156/292] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:44 2022] GET /compute/v2.1/servers/ef32fe68-b121-4fdf-874b-db3e366da292 => generated 1208 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:44.237881 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-b26d1ace-e14b-48a2-8ac7-bf41aea409b2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:44.254112 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-b26d1ace-e14b-48a2-8ac7-bf41aea409b2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523" status: 200 len: 1519 microversion: 2.1 time: 0.246863 May 23 15:43:44.264138 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 137/293] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:44 2022] GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523 => generated 1519 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:43:45.170052 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-b3292c17-2a9b-408d-bc08-2183b29b0067 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:45.170978 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-b3292c17-2a9b-408d-bc08-2183b29b0067 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] [instance: ef32fe68-b121-4fdf-874b-db3e366da292] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:45.177954 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-b3292c17-2a9b-408d-bc08-2183b29b0067 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:45.178381 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-b3292c17-2a9b-408d-bc08-2183b29b0067 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:45.179166 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-b3292c17-2a9b-408d-bc08-2183b29b0067 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:45.179603 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-b3292c17-2a9b-408d-bc08-2183b29b0067 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:45.266921 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-b3292c17-2a9b-408d-bc08-2183b29b0067 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6badcf8b92dc43a3bc2342e303dec1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ef57ea448a49d3af268a02f6f08257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:45.277798 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-b3292c17-2a9b-408d-bc08-2183b29b0067 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] 10.222.0.64 "GET /compute/v2.1/servers/ef32fe68-b121-4fdf-874b-db3e366da292" status: 200 len: 1264 microversion: 2.1 time: 0.111553 May 23 15:43:45.278861 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 157/294] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:45 2022] GET /compute/v2.1/servers/ef32fe68-b121-4fdf-874b-db3e366da292 => generated 1264 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:45.281043 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-2214cc1c-2ca7-4eb3-bba1-33e9f934505e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:45.281686 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-2214cc1c-2ca7-4eb3-bba1-33e9f934505e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: bbe72f52-c8f9-46ea-ae59-9d2fe0a49523] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:45.293780 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-2214cc1c-2ca7-4eb3-bba1-33e9f934505e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:45.294525 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-2214cc1c-2ca7-4eb3-bba1-33e9f934505e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:45.295307 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-2214cc1c-2ca7-4eb3-bba1-33e9f934505e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:45.298852 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-2214cc1c-2ca7-4eb3-bba1-33e9f934505e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:45.319061 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:43:45.487994 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-2214cc1c-2ca7-4eb3-bba1-33e9f934505e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:45.497811 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-2214cc1c-2ca7-4eb3-bba1-33e9f934505e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523" status: 200 len: 1519 microversion: 2.1 time: 0.225195 May 23 15:43:45.498399 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 138/295] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:45 2022] GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523 => generated 1519 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:43:45.698246 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-71ef1e65-a61a-4f2d-81ea-76aa1483e1c3 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1128890507", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-503509047", "security_groups": [{"name": "tempest-secgroup-smoke-741736392"}], "networks": [{"uuid": "52f38aa2-2e8c-4bbb-b78a-8086514940da"}], "block_device_mapping_v2": [{"uuid": "d598eb52-d073-47c4-9685-639dc69726d5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:43:45.797314 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [req-e6c5e0e0-e666-470a-bc17-f30becbb91bd req-8899a6ca-1e5d-4b16-9c3c-54992b05177f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce2cd056-b2f1-43fb-a60a-323039d15162", "tag": "cefdd54f-7186-4994-802f-370961a2ffcb"}]} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:43:45.802358 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_api:SELECT=90 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:43:45.809273 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-e6c5e0e0-e666-470a-bc17-f30becbb91bd req-8899a6ca-1e5d-4b16-9c3c-54992b05177f service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:45.810035 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-e6c5e0e0-e666-470a-bc17-f30becbb91bd req-8899a6ca-1e5d-4b16-9c3c-54992b05177f service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:45.823327 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.compute.server_external_events [req-e6c5e0e0-e666-470a-bc17-f30becbb91bd req-8899a6ca-1e5d-4b16-9c3c-54992b05177f service nova] Creating event network-changed:cefdd54f-7186-4994-802f-370961a2ffcb for instance ce2cd056-b2f1-43fb-a60a-323039d15162 on hv-cinder-84067 May 23 15:43:45.828976 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [req-e6c5e0e0-e666-470a-bc17-f30becbb91bd req-8899a6ca-1e5d-4b16-9c3c-54992b05177f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035772 May 23 15:43:45.831805 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 139/296] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:43:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:43:45.848351 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.network.neutron [None req-71ef1e65-a61a-4f2d-81ea-76aa1483e1c3 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] validate_networks() for [('52f38aa2-2e8c-4bbb-b78a-8086514940da', None, None, None, None, None)] {{(pid=124934) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 15:43:46.096981 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-bd84da23-ffc9-4038-ae58-171999a257e6 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:43:46.105304 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-bd84da23-ffc9-4038-ae58-171999a257e6 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:46.106071 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-bd84da23-ffc9-4038-ae58-171999a257e6 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:46.202216 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-bd84da23-ffc9-4038-ae58-171999a257e6 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Going to try to stop instance {{(pid=124933) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 23 15:43:46.438692 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-bd84da23-ffc9-4038-ae58-171999a257e6 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "POST /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358/action" status: 202 len: 0 microversion: 2.1 time: 0.346749 May 23 15:43:46.443108 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 140/297] 10.222.0.64 () {60 vars in 1277 bytes} [Mon May 23 15:43:46 2022] POST /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358/action => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 15:43:46.476869 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-7a1cba94-310d-49b6-8a78-16df853e692f tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:46.484027 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-7a1cba94-310d-49b6-8a78-16df853e692f tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] [instance: ef32fe68-b121-4fdf-874b-db3e366da292] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:46.505981 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-7a1cba94-310d-49b6-8a78-16df853e692f tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:46.506435 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-7a1cba94-310d-49b6-8a78-16df853e692f tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:46.507226 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-7a1cba94-310d-49b6-8a78-16df853e692f tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:46.507662 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-7a1cba94-310d-49b6-8a78-16df853e692f tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:46.631222 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-7a1cba94-310d-49b6-8a78-16df853e692f tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6badcf8b92dc43a3bc2342e303dec1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ef57ea448a49d3af268a02f6f08257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:46.639760 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-7a1cba94-310d-49b6-8a78-16df853e692f tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] 10.222.0.64 "GET /compute/v2.1/servers/ef32fe68-b121-4fdf-874b-db3e366da292" status: 200 len: 1282 microversion: 2.1 time: 0.194348 May 23 15:43:46.640822 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 141/298] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:46 2022] GET /compute/v2.1/servers/ef32fe68-b121-4fdf-874b-db3e366da292 => generated 1282 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:46.648938 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-815db125-fbb4-492e-acc0-8f511e8debbd tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:46.649571 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-815db125-fbb4-492e-acc0-8f511e8debbd tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:46.656713 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-815db125-fbb4-492e-acc0-8f511e8debbd tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:46.658136 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-815db125-fbb4-492e-acc0-8f511e8debbd tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:46.658471 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-815db125-fbb4-492e-acc0-8f511e8debbd tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:46.659288 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-815db125-fbb4-492e-acc0-8f511e8debbd tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:47.159033 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-815db125-fbb4-492e-acc0-8f511e8debbd tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:47.168145 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-815db125-fbb4-492e-acc0-8f511e8debbd tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 200 len: 1722 microversion: 2.1 time: 0.526062 May 23 15:43:47.168722 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 142/299] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:46 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 1722 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:47.174699 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-2c023fe5-3fad-4fcb-ba85-cd1ea84c66f3 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:47.182051 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-2c023fe5-3fad-4fcb-ba85-cd1ea84c66f3 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: bbe72f52-c8f9-46ea-ae59-9d2fe0a49523] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:47.183424 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-2c023fe5-3fad-4fcb-ba85-cd1ea84c66f3 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:47.184203 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-2c023fe5-3fad-4fcb-ba85-cd1ea84c66f3 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:47.185437 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-2c023fe5-3fad-4fcb-ba85-cd1ea84c66f3 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:47.186212 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-2c023fe5-3fad-4fcb-ba85-cd1ea84c66f3 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:47.624348 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.virt.hardware [None req-71ef1e65-a61a-4f2d-81ea-76aa1483e1c3 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Flavor limits 0:0:0 {{(pid=124934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 15:43:47.625742 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.virt.hardware [None req-71ef1e65-a61a-4f2d-81ea-76aa1483e1c3 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Image limits 0:0:0 {{(pid=124934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 15:43:47.626490 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.virt.hardware [None req-71ef1e65-a61a-4f2d-81ea-76aa1483e1c3 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Flavor pref 0:0:0 {{(pid=124934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 15:43:47.627205 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.virt.hardware [None req-71ef1e65-a61a-4f2d-81ea-76aa1483e1c3 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Image pref 0:0:0 {{(pid=124934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 15:43:47.628741 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.virt.hardware [None req-71ef1e65-a61a-4f2d-81ea-76aa1483e1c3 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 15:43:47.634824 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-2c023fe5-3fad-4fcb-ba85-cd1ea84c66f3 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:47.640101 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-71ef1e65-a61a-4f2d-81ea-76aa1483e1c3 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:47.640101 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-71ef1e65-a61a-4f2d-81ea-76aa1483e1c3 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:47.640824 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-71ef1e65-a61a-4f2d-81ea-76aa1483e1c3 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:47.641444 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-71ef1e65-a61a-4f2d-81ea-76aa1483e1c3 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:47.648202 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-2c023fe5-3fad-4fcb-ba85-cd1ea84c66f3 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523" status: 200 len: 1499 microversion: 2.1 time: 0.478038 May 23 15:43:47.649562 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 143/300] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:47 2022] GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523 => generated 1499 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:47.663532 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.quota [None req-71ef1e65-a61a-4f2d-81ea-76aa1483e1c3 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Getting quotas for project e0860b3d072246d49cd43a900351d571. Resources: {'ram', 'instances', 'cores'} {{(pid=124934) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 15:43:47.667930 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.quota [None req-71ef1e65-a61a-4f2d-81ea-76aa1483e1c3 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Getting quotas for user 8b983c0a2a124ac3aa3403e0777612f7 and project e0860b3d072246d49cd43a900351d571. Resources: {'ram', 'instances', 'cores'} {{(pid=124934) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 15:43:47.674856 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-a0f3d356-341e-4a99-a2ce-88943411772a tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:47.674856 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-a0f3d356-341e-4a99-a2ce-88943411772a tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] [instance: ef32fe68-b121-4fdf-874b-db3e366da292] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:47.679248 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a0f3d356-341e-4a99-a2ce-88943411772a tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:47.679772 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a0f3d356-341e-4a99-a2ce-88943411772a tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:47.681626 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a0f3d356-341e-4a99-a2ce-88943411772a tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:47.682115 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a0f3d356-341e-4a99-a2ce-88943411772a tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:47.737561 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-71ef1e65-a61a-4f2d-81ea-76aa1483e1c3 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Going to run 1 instances... {{(pid=124934) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 15:43:47.739872 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-71ef1e65-a61a-4f2d-81ea-76aa1483e1c3 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] [instance: dd66096c-0b64-4a26-bdec-1b1a46310cfb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d598eb52-d073-47c4-9685-639dc69726d5',volume_size=None,volume_type=None)] {{(pid=124934) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 15:43:47.807263 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-a0f3d356-341e-4a99-a2ce-88943411772a tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6badcf8b92dc43a3bc2342e303dec1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ef57ea448a49d3af268a02f6f08257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:47.815726 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-a0f3d356-341e-4a99-a2ce-88943411772a tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] 10.222.0.64 "GET /compute/v2.1/servers/ef32fe68-b121-4fdf-874b-db3e366da292" status: 200 len: 1270 microversion: 2.1 time: 0.152421 May 23 15:43:47.816460 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 144/301] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:47 2022] GET /compute/v2.1/servers/ef32fe68-b121-4fdf-874b-db3e366da292 => generated 1270 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:43:47.821714 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-e24173aa-b208-4518-b994-3c11fe5d6da4 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e5b3807f-70e1-4a06-a5f6-9b27ad32ada7"}} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:43:47.822975 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-e24173aa-b208-4518-b994-3c11fe5d6da4 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: bbe72f52-c8f9-46ea-ae59-9d2fe0a49523] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:47.829384 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e24173aa-b208-4518-b994-3c11fe5d6da4 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:47.829843 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e24173aa-b208-4518-b994-3c11fe5d6da4 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:47.831862 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e24173aa-b208-4518-b994-3c11fe5d6da4 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:47.831862 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e24173aa-b208-4518-b994-3c11fe5d6da4 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:47.856121 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.wsgi [None req-e24173aa-b208-4518-b994-3c11fe5d6da4 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] HTTP exception thrown: Cannot 'attach_volume' instance bbe72f52-c8f9-46ea-ae59-9d2fe0a49523 while it is in vm_state rescued May 23 15:43:47.858283 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-e24173aa-b208-4518-b994-3c11fe5d6da4 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Request method failure captured: May 23 15:43:47.858283 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: request: POST /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523/os-volume_attachments HTTP/1.1 May 23 15:43:47.858283 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Accept: application/json May 23 15:43:47.858283 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Accept-Encoding: identity May 23 15:43:47.858283 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Connection: close May 23 15:43:47.858283 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Content-Length: 74 May 23 15:43:47.858283 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Content-Type: application/json May 23 15:43:47.858283 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Host: 10.222.0.64 May 23 15:43:47.858283 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Openstack-System-Scope: None May 23 15:43:47.858283 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: User-Agent: python-urllib3/1.26.9 May 23 15:43:47.858283 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Auth-Token: gAAAAABii6s54KKAZxlQBYzhx-noNW6ImMu_qK18vzcxUodmAjvvJq-5TbaxZQIihTpeBFGJg_t4VXTJRBBdNp2S6NOFiVOcgKlGDwULP0bkoXn2Lrupumn987Hv9EwEHbef7k6ahcCsqTc5NRw34uO7WRPXXMvHMUWgqgfV68m8j7DAWMdthmk May 23 15:43:47.858283 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Domain-Id: None May 23 15:43:47.858283 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Domain-Name: None May 23 15:43:47.858283 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Identity-Status: Confirmed May 23 15:43:47.858283 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Is-Admin-Project: True May 23 15:43:47.858283 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Domain-Id: default May 23 15:43:47.858283 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Domain-Name: Default May 23 15:43:47.858283 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Id: 65483f2a0c914022b38e501691095c51 May 23 15:43:47.858283 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1263770255 May 23 15:43:47.858283 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Role: reader,member May 23 15:43:47.858283 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Roles: reader,member May 23 15:43:47.859594 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/65483f2a0c914022b38e501691095c51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/65483f2a0c914022b38e501691095c51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/65483f2a0c914022b38e501691095c51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_65483f2a0c914022b38e501691095c51", "adminURL": "http://10.222.0.64:8080"}]}] May 23 15:43:47.859594 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1263770255 May 23 15:43:47.859594 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant-Id: 65483f2a0c914022b38e501691095c51 May 23 15:43:47.859594 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1263770255 May 23 15:43:47.859594 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User: tempest-ServerRescueNegativeTestJSON-1263770255-project May 23 15:43:47.859594 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Domain-Id: default May 23 15:43:47.859594 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Domain-Name: Default May 23 15:43:47.859594 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Id: a2f1d435732b4ff0a60599309c66eeb5 May 23 15:43:47.859594 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1263770255-project May 23 15:43:47.859594 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: May 23 15:43:47.859594 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: {"volumeAttachment": {"volumeId": "e5b3807f-70e1-4a06-a5f6-9b27ad32ada7"}} May 23 15:43:47.859594 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: method: > May 23 15:43:47.860393 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: exception: Cannot 'attach_volume' instance bbe72f52-c8f9-46ea-ae59-9d2fe0a49523 while it is in vm_state rescued May 23 15:43:47.860393 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: action_args: {'server_id': 'bbe72f52-c8f9-46ea-ae59-9d2fe0a49523', 'body': {'volumeAttachment': {'volumeId': 'e5b3807f-70e1-4a06-a5f6-9b27ad32ada7'}}} May 23 15:43:47.860393 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:43:47.860393 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:43:47.860393 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 23 15:43:47.860393 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 23 15:43:47.860393 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 23 15:43:47.860393 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 15:43:47.860393 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 23 15:43:47.860393 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 23 15:43:47.860393 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance bbe72f52-c8f9-46ea-ae59-9d2fe0a49523 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 23 15:43:47.860393 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:43:47.860393 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:43:47.860393 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:43:47.860393 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:43:47.860393 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:43:47.860393 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:43:47.860393 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:43:47.860393 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:43:47.861554 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:43:47.861554 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:43:47.861554 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 15:43:47.861554 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 15:43:47.861554 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 15:43:47.861554 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 15:43:47.861554 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 15:43:47.861554 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 15:43:47.861554 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 23 15:43:47.861554 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 23 15:43:47.861554 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 23 15:43:47.861554 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 23 15:43:47.861554 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance bbe72f52-c8f9-46ea-ae59-9d2fe0a49523 while it is in vm_state rescued May 23 15:43:47.861554 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:43:47.861554 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:43:47.861554 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:43:47.861554 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:43:47.861554 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:43:47.861554 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:43:47.862685 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:43:47.862685 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:43:47.862685 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance bbe72f52-c8f9-46ea-ae59-9d2fe0a49523 while it is in vm_state rescued May 23 15:43:47.862685 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:43:47.862685 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-e24173aa-b208-4518-b994-3c11fe5d6da4 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Returning 409 to user: Cannot 'attach_volume' instance bbe72f52-c8f9-46ea-ae59-9d2fe0a49523 while it is in vm_state rescued {{(pid=124933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:43:47.862685 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-e24173aa-b208-4518-b994-3c11fe5d6da4 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "POST /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.042290 May 23 15:43:47.862685 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 145/302] 10.222.0.64 () {60 vars in 1322 bytes} [Mon May 23 15:43:47 2022] POST /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523/os-volume_attachments => generated 152 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 23 15:43:47.874218 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-4c746f77-d9a8-4471-8285-197b5e75fae7 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:43:47.874887 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-4c746f77-d9a8-4471-8285-197b5e75fae7 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: bbe72f52-c8f9-46ea-ae59-9d2fe0a49523] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:47.883012 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-4c746f77-d9a8-4471-8285-197b5e75fae7 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:47.883470 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-4c746f77-d9a8-4471-8285-197b5e75fae7 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:47.884475 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-4c746f77-d9a8-4471-8285-197b5e75fae7 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:47.884929 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-4c746f77-d9a8-4471-8285-197b5e75fae7 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:48.121133 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-4c746f77-d9a8-4471-8285-197b5e75fae7 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "POST /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523/action" status: 202 len: 0 microversion: 2.1 time: 0.251227 May 23 15:43:48.121820 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 146/303] 10.222.0.64 () {60 vars in 1277 bytes} [Mon May 23 15:43:47 2022] POST /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 23 15:43:48.130699 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-2bf1903b-24ef-4da6-914a-1b0d289ca64c tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:48.130902 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-71ef1e65-a61a-4f2d-81ea-76aa1483e1c3 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.436975 May 23 15:43:48.131407 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-2bf1903b-24ef-4da6-914a-1b0d289ca64c tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: bbe72f52-c8f9-46ea-ae59-9d2fe0a49523] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:48.136502 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 158/304] 10.222.0.64 () {60 vars in 1146 bytes} [Mon May 23 15:43:45 2022] POST /compute/v2.1/servers => generated 405 bytes in 2443 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 23 15:43:48.138295 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-2bf1903b-24ef-4da6-914a-1b0d289ca64c tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:48.138759 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-2bf1903b-24ef-4da6-914a-1b0d289ca64c tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:48.139520 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-2bf1903b-24ef-4da6-914a-1b0d289ca64c tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:48.140156 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-2bf1903b-24ef-4da6-914a-1b0d289ca64c tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:48.141802 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-5ef422e0-f867-4bfd-bef5-2de415ddef7a tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:48.142658 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-5ef422e0-f867-4bfd-bef5-2de415ddef7a tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] [instance: dd66096c-0b64-4a26-bdec-1b1a46310cfb] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:48.248426 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-5ef422e0-f867-4bfd-bef5-2de415ddef7a tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b983c0a2a124ac3aa3403e0777612f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0860b3d072246d49cd43a900351d571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:48.257944 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-5ef422e0-f867-4bfd-bef5-2de415ddef7a tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] 10.222.0.64 "GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb" status: 200 len: 1088 microversion: 2.1 time: 0.120218 May 23 15:43:48.258749 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 159/305] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:48 2022] GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb => generated 1088 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:48.271813 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-53afec66-3b3b-4730-86fa-351cd6f7b2fe tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:48.276758 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-53afec66-3b3b-4730-86fa-351cd6f7b2fe tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:48.287361 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-53afec66-3b3b-4730-86fa-351cd6f7b2fe tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:48.287833 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-53afec66-3b3b-4730-86fa-351cd6f7b2fe tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:48.288628 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-53afec66-3b3b-4730-86fa-351cd6f7b2fe tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:48.289090 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-53afec66-3b3b-4730-86fa-351cd6f7b2fe tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:48.385777 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-2bf1903b-24ef-4da6-914a-1b0d289ca64c tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:48.393514 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-2bf1903b-24ef-4da6-914a-1b0d289ca64c tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523" status: 200 len: 1507 microversion: 2.1 time: 0.267178 May 23 15:43:48.394086 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 147/306] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:48 2022] GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523 => generated 1507 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:48.444725 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-53afec66-3b3b-4730-86fa-351cd6f7b2fe tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:48.452780 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-53afec66-3b3b-4730-86fa-351cd6f7b2fe tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 200 len: 1722 microversion: 2.1 time: 0.192899 May 23 15:43:48.453372 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 160/307] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:48 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 1722 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:48.835208 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-1448bdef-121c-4cc5-824a-1eab28c4a0b9 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:48.835948 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-1448bdef-121c-4cc5-824a-1eab28c4a0b9 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] [instance: ef32fe68-b121-4fdf-874b-db3e366da292] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:48.842411 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1448bdef-121c-4cc5-824a-1eab28c4a0b9 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:48.842941 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1448bdef-121c-4cc5-824a-1eab28c4a0b9 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:48.843722 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1448bdef-121c-4cc5-824a-1eab28c4a0b9 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:48.844186 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1448bdef-121c-4cc5-824a-1eab28c4a0b9 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:48.984296 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-1448bdef-121c-4cc5-824a-1eab28c4a0b9 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6badcf8b92dc43a3bc2342e303dec1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ef57ea448a49d3af268a02f6f08257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:48.990731 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-1448bdef-121c-4cc5-824a-1eab28c4a0b9 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] 10.222.0.64 "GET /compute/v2.1/servers/ef32fe68-b121-4fdf-874b-db3e366da292" status: 200 len: 1312 microversion: 2.1 time: 0.161732 May 23 15:43:48.994823 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 148/308] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:48 2022] GET /compute/v2.1/servers/ef32fe68-b121-4fdf-874b-db3e366da292 => generated 1312 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:49.275220 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-95877736-028b-4c49-8718-a5a970c17adf tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:49.275954 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-95877736-028b-4c49-8718-a5a970c17adf tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] [instance: dd66096c-0b64-4a26-bdec-1b1a46310cfb] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:49.331841 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-95877736-028b-4c49-8718-a5a970c17adf tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b983c0a2a124ac3aa3403e0777612f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0860b3d072246d49cd43a900351d571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:49.338585 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-95877736-028b-4c49-8718-a5a970c17adf tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] 10.222.0.64 "GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb" status: 200 len: 1088 microversion: 2.1 time: 0.067297 May 23 15:43:49.339132 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 161/309] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:49 2022] GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb => generated 1088 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:49.412134 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-0a615974-461f-4404-acfb-c64977bce17e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:49.412814 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-0a615974-461f-4404-acfb-c64977bce17e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: bbe72f52-c8f9-46ea-ae59-9d2fe0a49523] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:49.419462 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-0a615974-461f-4404-acfb-c64977bce17e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:49.419991 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-0a615974-461f-4404-acfb-c64977bce17e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:49.421154 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-0a615974-461f-4404-acfb-c64977bce17e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:49.421582 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-0a615974-461f-4404-acfb-c64977bce17e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:49.470692 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-75dc41d8-4612-4837-8393-30f88d3b9846 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:49.472118 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-75dc41d8-4612-4837-8393-30f88d3b9846 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:49.478221 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-75dc41d8-4612-4837-8393-30f88d3b9846 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:49.478669 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-75dc41d8-4612-4837-8393-30f88d3b9846 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:49.479429 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-75dc41d8-4612-4837-8393-30f88d3b9846 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:49.479871 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-75dc41d8-4612-4837-8393-30f88d3b9846 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:49.606081 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-0a615974-461f-4404-acfb-c64977bce17e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:49.614908 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-0a615974-461f-4404-acfb-c64977bce17e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523" status: 200 len: 1507 microversion: 2.1 time: 0.207369 May 23 15:43:49.616752 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 149/310] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:49 2022] GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523 => generated 1507 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:49.653114 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-75dc41d8-4612-4837-8393-30f88d3b9846 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:49.661627 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-75dc41d8-4612-4837-8393-30f88d3b9846 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 200 len: 1722 microversion: 2.1 time: 0.194785 May 23 15:43:49.662192 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 162/311] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:49 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:43:50.011032 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-a28a8684-8bba-4332-aeef-248f531b8222 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:50.011638 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-a28a8684-8bba-4332-aeef-248f531b8222 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] [instance: ef32fe68-b121-4fdf-874b-db3e366da292] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:50.017539 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a28a8684-8bba-4332-aeef-248f531b8222 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:50.017988 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a28a8684-8bba-4332-aeef-248f531b8222 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:50.018745 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a28a8684-8bba-4332-aeef-248f531b8222 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:50.019175 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a28a8684-8bba-4332-aeef-248f531b8222 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:50.311956 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-a28a8684-8bba-4332-aeef-248f531b8222 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6badcf8b92dc43a3bc2342e303dec1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ef57ea448a49d3af268a02f6f08257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:50.321468 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-a28a8684-8bba-4332-aeef-248f531b8222 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] 10.222.0.64 "GET /compute/v2.1/servers/ef32fe68-b121-4fdf-874b-db3e366da292" status: 200 len: 1312 microversion: 2.1 time: 0.314118 May 23 15:43:50.333228 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 150/312] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:50 2022] GET /compute/v2.1/servers/ef32fe68-b121-4fdf-874b-db3e366da292 => generated 1312 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:50.362735 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-36297ea6-95b8-47ae-831e-dd4502eecd99 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:50.364822 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-36297ea6-95b8-47ae-831e-dd4502eecd99 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] [instance: dd66096c-0b64-4a26-bdec-1b1a46310cfb] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:50.372718 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-36297ea6-95b8-47ae-831e-dd4502eecd99 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:50.373382 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-36297ea6-95b8-47ae-831e-dd4502eecd99 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:50.375455 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-36297ea6-95b8-47ae-831e-dd4502eecd99 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:50.375909 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-36297ea6-95b8-47ae-831e-dd4502eecd99 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:50.480657 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-36297ea6-95b8-47ae-831e-dd4502eecd99 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b983c0a2a124ac3aa3403e0777612f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0860b3d072246d49cd43a900351d571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:50.490206 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-36297ea6-95b8-47ae-831e-dd4502eecd99 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] 10.222.0.64 "GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb" status: 200 len: 1130 microversion: 2.1 time: 0.137958 May 23 15:43:50.490983 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 163/313] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:50 2022] GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb => generated 1130 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:50.652970 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-2b4c991c-59ef-4b14-b5cf-efceb5396d8e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:50.653779 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-2b4c991c-59ef-4b14-b5cf-efceb5396d8e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: bbe72f52-c8f9-46ea-ae59-9d2fe0a49523] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:50.661127 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-2b4c991c-59ef-4b14-b5cf-efceb5396d8e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:50.661676 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-2b4c991c-59ef-4b14-b5cf-efceb5396d8e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:50.662524 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-2b4c991c-59ef-4b14-b5cf-efceb5396d8e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:50.663032 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-2b4c991c-59ef-4b14-b5cf-efceb5396d8e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:50.678768 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-d1ff2eac-5a27-413d-8d56-38365ba8a3d0 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:50.679394 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-d1ff2eac-5a27-413d-8d56-38365ba8a3d0 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:50.686282 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-d1ff2eac-5a27-413d-8d56-38365ba8a3d0 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:50.686742 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-d1ff2eac-5a27-413d-8d56-38365ba8a3d0 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:50.687518 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-d1ff2eac-5a27-413d-8d56-38365ba8a3d0 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:50.687950 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-d1ff2eac-5a27-413d-8d56-38365ba8a3d0 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:50.990848 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-2b4c991c-59ef-4b14-b5cf-efceb5396d8e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:50.998169 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-2b4c991c-59ef-4b14-b5cf-efceb5396d8e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523" status: 200 len: 1507 microversion: 2.1 time: 0.349556 May 23 15:43:50.998738 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 151/314] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:50 2022] GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523 => generated 1507 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:51.015914 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-d1ff2eac-5a27-413d-8d56-38365ba8a3d0 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:51.024265 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-d1ff2eac-5a27-413d-8d56-38365ba8a3d0 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 200 len: 1722 microversion: 2.1 time: 0.349923 May 23 15:43:51.024825 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 164/315] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:50 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 1722 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:51.263595 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [req-264dd2b7-4ea9-4ecf-8f40-0ef89a13ddfc req-94a15074-c356-4608-85ae-85e867ee8abf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef32fe68-b121-4fdf-874b-db3e366da292", "tag": "8cb9cf89-cdd7-4d17-9a07-d6bba5ceb545"}]} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:43:51.273136 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-264dd2b7-4ea9-4ecf-8f40-0ef89a13ddfc req-94a15074-c356-4608-85ae-85e867ee8abf service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:51.276052 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-264dd2b7-4ea9-4ecf-8f40-0ef89a13ddfc req-94a15074-c356-4608-85ae-85e867ee8abf service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:51.286214 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.compute.server_external_events [req-264dd2b7-4ea9-4ecf-8f40-0ef89a13ddfc req-94a15074-c356-4608-85ae-85e867ee8abf service nova] Creating event network-changed:8cb9cf89-cdd7-4d17-9a07-d6bba5ceb545 for instance ef32fe68-b121-4fdf-874b-db3e366da292 on hv-cinder-84067 May 23 15:43:51.290909 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [req-264dd2b7-4ea9-4ecf-8f40-0ef89a13ddfc req-94a15074-c356-4608-85ae-85e867ee8abf service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031143 May 23 15:43:51.292003 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 152/316] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:43:51.338791 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-ee54f08c-f5d6-4765-8407-a67208ffdd04 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:51.339621 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-ee54f08c-f5d6-4765-8407-a67208ffdd04 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] [instance: ef32fe68-b121-4fdf-874b-db3e366da292] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:51.350784 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ee54f08c-f5d6-4765-8407-a67208ffdd04 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:51.350784 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ee54f08c-f5d6-4765-8407-a67208ffdd04 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:51.350784 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ee54f08c-f5d6-4765-8407-a67208ffdd04 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:51.350784 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ee54f08c-f5d6-4765-8407-a67208ffdd04 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:51.508397 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-c990135b-7335-486f-8d79-183479d3697c tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:51.509401 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-c990135b-7335-486f-8d79-183479d3697c tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] [instance: dd66096c-0b64-4a26-bdec-1b1a46310cfb] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:51.510179 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-ee54f08c-f5d6-4765-8407-a67208ffdd04 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6badcf8b92dc43a3bc2342e303dec1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ef57ea448a49d3af268a02f6f08257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:51.515774 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c990135b-7335-486f-8d79-183479d3697c tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:51.516226 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c990135b-7335-486f-8d79-183479d3697c tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:51.516999 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c990135b-7335-486f-8d79-183479d3697c tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:51.517482 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c990135b-7335-486f-8d79-183479d3697c tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:51.519497 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-ee54f08c-f5d6-4765-8407-a67208ffdd04 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] 10.222.0.64 "GET /compute/v2.1/servers/ef32fe68-b121-4fdf-874b-db3e366da292" status: 200 len: 1312 microversion: 2.1 time: 0.184772 May 23 15:43:51.520221 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 165/317] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:51 2022] GET /compute/v2.1/servers/ef32fe68-b121-4fdf-874b-db3e366da292 => generated 1312 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:43:51.584885 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-c990135b-7335-486f-8d79-183479d3697c tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b983c0a2a124ac3aa3403e0777612f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0860b3d072246d49cd43a900351d571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:51.592324 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-c990135b-7335-486f-8d79-183479d3697c tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] 10.222.0.64 "GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb" status: 200 len: 1194 microversion: 2.1 time: 0.088305 May 23 15:43:51.592876 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 153/318] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:51 2022] GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb => generated 1194 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:52.015742 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-540324e8-56d5-480f-875d-0b5fdbdfea4a tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:52.016288 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-540324e8-56d5-480f-875d-0b5fdbdfea4a tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: bbe72f52-c8f9-46ea-ae59-9d2fe0a49523] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:52.023211 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-540324e8-56d5-480f-875d-0b5fdbdfea4a tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:52.023675 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-540324e8-56d5-480f-875d-0b5fdbdfea4a tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:52.024570 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-540324e8-56d5-480f-875d-0b5fdbdfea4a tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:52.025019 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-540324e8-56d5-480f-875d-0b5fdbdfea4a tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:52.045982 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-cbbb63e0-233e-4fc7-a799-a880f151ff76 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:52.046596 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-cbbb63e0-233e-4fc7-a799-a880f151ff76 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:52.048954 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_cell0:SELECT=2 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:43:52.054254 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-cbbb63e0-233e-4fc7-a799-a880f151ff76 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:52.054708 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-cbbb63e0-233e-4fc7-a799-a880f151ff76 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:52.055478 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-cbbb63e0-233e-4fc7-a799-a880f151ff76 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:52.055911 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-cbbb63e0-233e-4fc7-a799-a880f151ff76 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:52.201862 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-540324e8-56d5-480f-875d-0b5fdbdfea4a tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:52.210287 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-540324e8-56d5-480f-875d-0b5fdbdfea4a tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523" status: 200 len: 1507 microversion: 2.1 time: 0.198439 May 23 15:43:52.211059 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 166/319] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:52 2022] GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523 => generated 1507 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:52.222472 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-cbbb63e0-233e-4fc7-a799-a880f151ff76 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:52.227190 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:43:52.231923 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-cbbb63e0-233e-4fc7-a799-a880f151ff76 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 200 len: 1722 microversion: 2.1 time: 0.190019 May 23 15:43:52.232485 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 154/320] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:52 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 1722 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:52.536415 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-54f35924-634e-4f4d-aac8-b0987780aa65 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:52.537082 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-54f35924-634e-4f4d-aac8-b0987780aa65 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] [instance: ef32fe68-b121-4fdf-874b-db3e366da292] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:52.543048 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-54f35924-634e-4f4d-aac8-b0987780aa65 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:52.543454 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-54f35924-634e-4f4d-aac8-b0987780aa65 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:52.544209 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-54f35924-634e-4f4d-aac8-b0987780aa65 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:52.544641 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-54f35924-634e-4f4d-aac8-b0987780aa65 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:52.611151 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-b341a137-69e7-41a3-a402-fe7a6f7dd193 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:52.611870 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-b341a137-69e7-41a3-a402-fe7a6f7dd193 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] [instance: dd66096c-0b64-4a26-bdec-1b1a46310cfb] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:52.622123 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b341a137-69e7-41a3-a402-fe7a6f7dd193 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:52.622698 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b341a137-69e7-41a3-a402-fe7a6f7dd193 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:52.623807 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b341a137-69e7-41a3-a402-fe7a6f7dd193 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:52.624497 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b341a137-69e7-41a3-a402-fe7a6f7dd193 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:52.731349 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-b341a137-69e7-41a3-a402-fe7a6f7dd193 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b983c0a2a124ac3aa3403e0777612f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0860b3d072246d49cd43a900351d571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:52.741300 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-b341a137-69e7-41a3-a402-fe7a6f7dd193 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] 10.222.0.64 "GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb" status: 200 len: 1194 microversion: 2.1 time: 0.135759 May 23 15:43:52.750687 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 155/321] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:52 2022] GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb => generated 1194 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:43:53.023470 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-54f35924-634e-4f4d-aac8-b0987780aa65 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6badcf8b92dc43a3bc2342e303dec1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ef57ea448a49d3af268a02f6f08257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:53.031018 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-54f35924-634e-4f4d-aac8-b0987780aa65 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] 10.222.0.64 "GET /compute/v2.1/servers/ef32fe68-b121-4fdf-874b-db3e366da292" status: 200 len: 1312 microversion: 2.1 time: 0.498457 May 23 15:43:53.034651 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 167/322] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:52 2022] GET /compute/v2.1/servers/ef32fe68-b121-4fdf-874b-db3e366da292 => generated 1312 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:53.227646 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-ee5d2a74-cd85-410f-beb9-adb1a4d641db tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:53.228328 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-ee5d2a74-cd85-410f-beb9-adb1a4d641db tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: bbe72f52-c8f9-46ea-ae59-9d2fe0a49523] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:53.235694 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ee5d2a74-cd85-410f-beb9-adb1a4d641db tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:53.236143 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ee5d2a74-cd85-410f-beb9-adb1a4d641db tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:53.236897 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ee5d2a74-cd85-410f-beb9-adb1a4d641db tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:53.237350 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ee5d2a74-cd85-410f-beb9-adb1a4d641db tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:53.252661 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-f4f0ea31-454e-4d7d-a85e-eedb7727ca93 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:53.253396 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-f4f0ea31-454e-4d7d-a85e-eedb7727ca93 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:53.259782 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-f4f0ea31-454e-4d7d-a85e-eedb7727ca93 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:53.260239 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-f4f0ea31-454e-4d7d-a85e-eedb7727ca93 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:53.261136 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-f4f0ea31-454e-4d7d-a85e-eedb7727ca93 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:53.261581 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-f4f0ea31-454e-4d7d-a85e-eedb7727ca93 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:53.441481 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-ee5d2a74-cd85-410f-beb9-adb1a4d641db tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:53.449599 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-ee5d2a74-cd85-410f-beb9-adb1a4d641db tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523" status: 200 len: 1513 microversion: 2.1 time: 0.225644 May 23 15:43:53.462428 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 156/323] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:53 2022] GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523 => generated 1513 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:53.466482 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-f4f0ea31-454e-4d7d-a85e-eedb7727ca93 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:53.476754 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-f4f0ea31-454e-4d7d-a85e-eedb7727ca93 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 200 len: 1722 microversion: 2.1 time: 0.227676 May 23 15:43:53.477361 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 168/324] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:53 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 1722 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:43:53.760637 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-c7afdf1c-427f-499a-8ae4-de75d9c4b1c0 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:53.761648 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-c7afdf1c-427f-499a-8ae4-de75d9c4b1c0 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] [instance: dd66096c-0b64-4a26-bdec-1b1a46310cfb] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:53.768285 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c7afdf1c-427f-499a-8ae4-de75d9c4b1c0 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:53.768846 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c7afdf1c-427f-499a-8ae4-de75d9c4b1c0 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:53.770351 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c7afdf1c-427f-499a-8ae4-de75d9c4b1c0 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:53.771008 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c7afdf1c-427f-499a-8ae4-de75d9c4b1c0 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:53.858108 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-c7afdf1c-427f-499a-8ae4-de75d9c4b1c0 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b983c0a2a124ac3aa3403e0777612f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0860b3d072246d49cd43a900351d571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:53.867522 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-c7afdf1c-427f-499a-8ae4-de75d9c4b1c0 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] 10.222.0.64 "GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb" status: 200 len: 1204 microversion: 2.1 time: 0.112226 May 23 15:43:53.868098 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 157/325] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:53 2022] GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb => generated 1204 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:54.048716 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-eaf9c7f8-03a8-402b-b27b-35f14e17a039 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:54.049901 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-eaf9c7f8-03a8-402b-b27b-35f14e17a039 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] [instance: ef32fe68-b121-4fdf-874b-db3e366da292] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:54.057413 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-eaf9c7f8-03a8-402b-b27b-35f14e17a039 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:54.057927 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-eaf9c7f8-03a8-402b-b27b-35f14e17a039 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:54.059067 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-eaf9c7f8-03a8-402b-b27b-35f14e17a039 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:54.059767 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-eaf9c7f8-03a8-402b-b27b-35f14e17a039 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:54.329751 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-eaf9c7f8-03a8-402b-b27b-35f14e17a039 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6badcf8b92dc43a3bc2342e303dec1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ef57ea448a49d3af268a02f6f08257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:54.338937 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-eaf9c7f8-03a8-402b-b27b-35f14e17a039 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] 10.222.0.64 "GET /compute/v2.1/servers/ef32fe68-b121-4fdf-874b-db3e366da292" status: 200 len: 1312 microversion: 2.1 time: 0.294822 May 23 15:43:54.349691 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 169/326] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:54 2022] GET /compute/v2.1/servers/ef32fe68-b121-4fdf-874b-db3e366da292 => generated 1312 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:54.504957 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-3722484e-f453-496c-bd20-b27866b3c552 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:54.505690 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-3722484e-f453-496c-bd20-b27866b3c552 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:54.512928 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-3722484e-f453-496c-bd20-b27866b3c552 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:54.513814 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-3722484e-f453-496c-bd20-b27866b3c552 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:54.514813 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-3722484e-f453-496c-bd20-b27866b3c552 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:54.515492 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-3722484e-f453-496c-bd20-b27866b3c552 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:54.669119 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-3722484e-f453-496c-bd20-b27866b3c552 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:54.678584 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-3722484e-f453-496c-bd20-b27866b3c552 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 200 len: 1722 microversion: 2.1 time: 0.178639 May 23 15:43:54.679186 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 158/327] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:54 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:54.887105 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-4b562dd6-fcd8-49eb-9d8e-4e8225481358 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:54.888431 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-4b562dd6-fcd8-49eb-9d8e-4e8225481358 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] [instance: dd66096c-0b64-4a26-bdec-1b1a46310cfb] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:54.895134 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4b562dd6-fcd8-49eb-9d8e-4e8225481358 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:54.895869 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4b562dd6-fcd8-49eb-9d8e-4e8225481358 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:54.896686 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4b562dd6-fcd8-49eb-9d8e-4e8225481358 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:54.897382 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4b562dd6-fcd8-49eb-9d8e-4e8225481358 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:55.074080 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-4b562dd6-fcd8-49eb-9d8e-4e8225481358 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b983c0a2a124ac3aa3403e0777612f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0860b3d072246d49cd43a900351d571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:55.082194 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-4b562dd6-fcd8-49eb-9d8e-4e8225481358 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] 10.222.0.64 "GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb" status: 200 len: 1271 microversion: 2.1 time: 0.201184 May 23 15:43:55.083094 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 170/328] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:54 2022] GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb => generated 1271 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:55.102490 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-006dde94-bfc7-4d31-ab54-d83c80469bbc tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Action: 'create', calling method: .version_select at 0x7fab5295bca0>, body: {"keypair": {"name": "tempest-keypair-1525748368", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFAAYL+RbY+DnXbXkf/F5zXD7OYwHqEhpoMklRhXQSjHkE+EPhplNKjmo99btgYaDrR2o8lJIk+0tHW3sVI8KfwTI1AZGiB1kNnC/6zUDiozchifAaGRSLe2VI1CW/5xA=="}} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:43:55.117614 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.quota [None req-006dde94-bfc7-4d31-ab54-d83c80469bbc tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Getting quotas for project 65483f2a0c914022b38e501691095c51. Resources: {'key_pairs'} {{(pid=124933) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 15:43:55.121445 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.quota [None req-006dde94-bfc7-4d31-ab54-d83c80469bbc tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Getting quotas for user a2f1d435732b4ff0a60599309c66eeb5 and project 65483f2a0c914022b38e501691095c51. Resources: {'key_pairs'} {{(pid=124933) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 15:43:55.186038 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [req-1b48cdba-aa57-4e35-868a-d740d4ce83b6 req-127a5a9f-c652-480d-bba0-3db463e85b88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd66096c-0b64-4a26-bdec-1b1a46310cfb", "tag": "a0610243-2466-4315-a3e6-15f6cea816b8"}]} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:43:55.196710 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-1b48cdba-aa57-4e35-868a-d740d4ce83b6 req-127a5a9f-c652-480d-bba0-3db463e85b88 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:55.197332 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-1b48cdba-aa57-4e35-868a-d740d4ce83b6 req-127a5a9f-c652-480d-bba0-3db463e85b88 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:55.213681 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.compute.server_external_events [req-1b48cdba-aa57-4e35-868a-d740d4ce83b6 req-127a5a9f-c652-480d-bba0-3db463e85b88 service nova] Creating event network-changed:a0610243-2466-4315-a3e6-15f6cea816b8 for instance dd66096c-0b64-4a26-bdec-1b1a46310cfb on hv-cinder-84067 May 23 15:43:55.219117 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [req-1b48cdba-aa57-4e35-868a-d740d4ce83b6 req-127a5a9f-c652-480d-bba0-3db463e85b88 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037228 May 23 15:43:55.219789 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 171/329] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:43:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:43:55.250280 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-006dde94-bfc7-4d31-ab54-d83c80469bbc tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.151768 May 23 15:43:55.251220 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 159/330] 10.222.0.64 () {60 vars in 1158 bytes} [Mon May 23 15:43:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:43:55.356813 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-12ba1d55-c32c-48d6-8ae0-9c571e127af0 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:55.359550 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-12ba1d55-c32c-48d6-8ae0-9c571e127af0 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] [instance: ef32fe68-b121-4fdf-874b-db3e366da292] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:55.367915 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-12ba1d55-c32c-48d6-8ae0-9c571e127af0 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:55.368629 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-12ba1d55-c32c-48d6-8ae0-9c571e127af0 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:55.369662 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-12ba1d55-c32c-48d6-8ae0-9c571e127af0 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:55.370320 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-12ba1d55-c32c-48d6-8ae0-9c571e127af0 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:55.537121 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-12ba1d55-c32c-48d6-8ae0-9c571e127af0 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6badcf8b92dc43a3bc2342e303dec1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ef57ea448a49d3af268a02f6f08257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:55.545597 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-12ba1d55-c32c-48d6-8ae0-9c571e127af0 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] 10.222.0.64 "GET /compute/v2.1/servers/ef32fe68-b121-4fdf-874b-db3e366da292" status: 200 len: 1312 microversion: 2.1 time: 0.193090 May 23 15:43:55.546874 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 172/331] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:55 2022] GET /compute/v2.1/servers/ef32fe68-b121-4fdf-874b-db3e366da292 => generated 1312 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:55.699770 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-921aaa79-4162-4166-8f0f-abdbf55fd246 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:55.699770 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-921aaa79-4162-4166-8f0f-abdbf55fd246 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:55.709928 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-921aaa79-4162-4166-8f0f-abdbf55fd246 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:55.711033 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-921aaa79-4162-4166-8f0f-abdbf55fd246 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:55.715387 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-921aaa79-4162-4166-8f0f-abdbf55fd246 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:55.715387 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-921aaa79-4162-4166-8f0f-abdbf55fd246 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:55.854303 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-921aaa79-4162-4166-8f0f-abdbf55fd246 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:55.862502 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-921aaa79-4162-4166-8f0f-abdbf55fd246 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 200 len: 1722 microversion: 2.1 time: 0.169997 May 23 15:43:55.864970 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 160/332] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:55 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:56.100798 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-62ebfb06-1376-45ab-b05c-36be3393adc2 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:56.101624 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-62ebfb06-1376-45ab-b05c-36be3393adc2 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] [instance: dd66096c-0b64-4a26-bdec-1b1a46310cfb] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:56.108554 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-62ebfb06-1376-45ab-b05c-36be3393adc2 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:56.109024 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-62ebfb06-1376-45ab-b05c-36be3393adc2 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:56.109879 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-62ebfb06-1376-45ab-b05c-36be3393adc2 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:56.110323 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-62ebfb06-1376-45ab-b05c-36be3393adc2 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:56.451983 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-62ebfb06-1376-45ab-b05c-36be3393adc2 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b983c0a2a124ac3aa3403e0777612f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0860b3d072246d49cd43a900351d571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:56.451983 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-62ebfb06-1376-45ab-b05c-36be3393adc2 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] 10.222.0.64 "GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb" status: 200 len: 1271 microversion: 2.1 time: 0.153484 May 23 15:43:56.451983 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 173/333] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:56 2022] GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb => generated 1271 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:56.563011 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-fd14b02d-ee45-4053-a954-3520e154975a tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:56.563629 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-fd14b02d-ee45-4053-a954-3520e154975a tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] [instance: ef32fe68-b121-4fdf-874b-db3e366da292] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:56.569647 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-fd14b02d-ee45-4053-a954-3520e154975a tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:56.572668 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-fd14b02d-ee45-4053-a954-3520e154975a tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:56.572668 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-fd14b02d-ee45-4053-a954-3520e154975a tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:56.572668 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-fd14b02d-ee45-4053-a954-3520e154975a tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:56.704489 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-fd14b02d-ee45-4053-a954-3520e154975a tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6badcf8b92dc43a3bc2342e303dec1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ef57ea448a49d3af268a02f6f08257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:56.713000 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-fd14b02d-ee45-4053-a954-3520e154975a tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] 10.222.0.64 "GET /compute/v2.1/servers/ef32fe68-b121-4fdf-874b-db3e366da292" status: 200 len: 1312 microversion: 2.1 time: 0.153876 May 23 15:43:56.713614 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 161/334] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:56 2022] GET /compute/v2.1/servers/ef32fe68-b121-4fdf-874b-db3e366da292 => generated 1312 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:56.885770 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-a3c63825-9712-4449-88d3-205f80d4edd9 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:56.886578 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-a3c63825-9712-4449-88d3-205f80d4edd9 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:56.892611 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-a3c63825-9712-4449-88d3-205f80d4edd9 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:56.893175 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-a3c63825-9712-4449-88d3-205f80d4edd9 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:56.894050 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-a3c63825-9712-4449-88d3-205f80d4edd9 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:56.895277 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-a3c63825-9712-4449-88d3-205f80d4edd9 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:56.899504 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_cell1:SELECT=100 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:43:57.028329 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-a3c63825-9712-4449-88d3-205f80d4edd9 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:57.036338 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-a3c63825-9712-4449-88d3-205f80d4edd9 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 200 len: 1722 microversion: 2.1 time: 0.154382 May 23 15:43:57.036905 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 174/335] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:56 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:57.455886 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-a98eefe3-b8d3-40cb-88ee-04194a03ffef tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:57.456494 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-a98eefe3-b8d3-40cb-88ee-04194a03ffef tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] [instance: dd66096c-0b64-4a26-bdec-1b1a46310cfb] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:57.462832 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a98eefe3-b8d3-40cb-88ee-04194a03ffef tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:57.463288 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a98eefe3-b8d3-40cb-88ee-04194a03ffef tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:57.464130 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a98eefe3-b8d3-40cb-88ee-04194a03ffef tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:57.464585 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a98eefe3-b8d3-40cb-88ee-04194a03ffef tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:57.610981 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-a98eefe3-b8d3-40cb-88ee-04194a03ffef tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b983c0a2a124ac3aa3403e0777612f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0860b3d072246d49cd43a900351d571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:57.619213 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-a98eefe3-b8d3-40cb-88ee-04194a03ffef tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] 10.222.0.64 "GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb" status: 200 len: 1271 microversion: 2.1 time: 0.167231 May 23 15:43:57.619768 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 162/336] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:57 2022] GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb => generated 1271 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:57.729956 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-c91c6000-2756-426e-ac87-d647888671c7 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:57.730701 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-c91c6000-2756-426e-ac87-d647888671c7 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] [instance: ef32fe68-b121-4fdf-874b-db3e366da292] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:57.732627 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_cell0:SELECT=4 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:43:57.737506 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-c91c6000-2756-426e-ac87-d647888671c7 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:57.738059 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-c91c6000-2756-426e-ac87-d647888671c7 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:57.738903 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-c91c6000-2756-426e-ac87-d647888671c7 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:57.739414 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-c91c6000-2756-426e-ac87-d647888671c7 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:57.869685 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-c91c6000-2756-426e-ac87-d647888671c7 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6badcf8b92dc43a3bc2342e303dec1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ef57ea448a49d3af268a02f6f08257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:57.877159 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-c91c6000-2756-426e-ac87-d647888671c7 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] 10.222.0.64 "GET /compute/v2.1/servers/ef32fe68-b121-4fdf-874b-db3e366da292" status: 200 len: 1312 microversion: 2.1 time: 0.151170 May 23 15:43:57.878396 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 175/337] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:57 2022] GET /compute/v2.1/servers/ef32fe68-b121-4fdf-874b-db3e366da292 => generated 1312 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:57.975134 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-04084e5f-1313-4e62-bf8f-a5e396fc9450 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1188863549", "imageRef": "a5c8503f-3733-426f-8a5b-c7c9358e4a45", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "eeca0c6c-3155-49db-bdc5-95de249b904d"}], "security_groups": [{"name": "tempest-securitygroup--699070741"}], "key_name": "tempest-keypair-1525748368", "user_data": "}} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:43:58.053864 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-d6408af8-7c10-47d7-8afc-d40d33a17642 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:58.054532 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-d6408af8-7c10-47d7-8afc-d40d33a17642 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:58.060439 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-d6408af8-7c10-47d7-8afc-d40d33a17642 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:58.060907 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-d6408af8-7c10-47d7-8afc-d40d33a17642 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:58.061694 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-d6408af8-7c10-47d7-8afc-d40d33a17642 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:58.062132 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-d6408af8-7c10-47d7-8afc-d40d33a17642 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:58.076199 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.network.neutron [None req-04084e5f-1313-4e62-bf8f-a5e396fc9450 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] validate_networks() for [('eeca0c6c-3155-49db-bdc5-95de249b904d', None, None, None, None, None)] {{(pid=124933) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 15:43:58.269255 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-d6408af8-7c10-47d7-8afc-d40d33a17642 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:58.277987 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-d6408af8-7c10-47d7-8afc-d40d33a17642 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 200 len: 1722 microversion: 2.1 time: 0.228160 May 23 15:43:58.278563 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 176/338] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:58 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 1722 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:43:58.532504 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.virt.hardware [None req-04084e5f-1313-4e62-bf8f-a5e396fc9450 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Flavor limits 0:0:0 {{(pid=124933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 15:43:58.532931 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.virt.hardware [None req-04084e5f-1313-4e62-bf8f-a5e396fc9450 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Image limits 0:0:0 {{(pid=124933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 15:43:58.533597 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.virt.hardware [None req-04084e5f-1313-4e62-bf8f-a5e396fc9450 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Flavor pref 0:0:0 {{(pid=124933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 15:43:58.534006 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.virt.hardware [None req-04084e5f-1313-4e62-bf8f-a5e396fc9450 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Image pref 0:0:0 {{(pid=124933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 15:43:58.534419 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.virt.hardware [None req-04084e5f-1313-4e62-bf8f-a5e396fc9450 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 15:43:58.543932 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-04084e5f-1313-4e62-bf8f-a5e396fc9450 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:58.544385 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-04084e5f-1313-4e62-bf8f-a5e396fc9450 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:58.545223 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-04084e5f-1313-4e62-bf8f-a5e396fc9450 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:58.550503 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-04084e5f-1313-4e62-bf8f-a5e396fc9450 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:58.562739 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.quota [None req-04084e5f-1313-4e62-bf8f-a5e396fc9450 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Getting quotas for project 65483f2a0c914022b38e501691095c51. Resources: {'ram', 'instances', 'cores'} {{(pid=124933) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 15:43:58.567523 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.quota [None req-04084e5f-1313-4e62-bf8f-a5e396fc9450 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Getting quotas for user a2f1d435732b4ff0a60599309c66eeb5 and project 65483f2a0c914022b38e501691095c51. Resources: {'ram', 'instances', 'cores'} {{(pid=124933) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 15:43:58.578339 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-04084e5f-1313-4e62-bf8f-a5e396fc9450 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Going to run 1 instances... {{(pid=124933) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 15:43:58.580568 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-04084e5f-1313-4e62-bf8f-a5e396fc9450 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 15c3a3b9-3d55-44c3-8627-ba397c1f069d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5c8503f-3733-426f-8a5b-c7c9358e4a45',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124933) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 15:43:58.636069 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-8304dd68-f5a8-4fa5-b0ee-06cacfa4d5f8 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:58.637247 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-8304dd68-f5a8-4fa5-b0ee-06cacfa4d5f8 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] [instance: dd66096c-0b64-4a26-bdec-1b1a46310cfb] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:58.643545 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-8304dd68-f5a8-4fa5-b0ee-06cacfa4d5f8 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:58.644019 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-8304dd68-f5a8-4fa5-b0ee-06cacfa4d5f8 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:58.644939 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-8304dd68-f5a8-4fa5-b0ee-06cacfa4d5f8 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:58.645532 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-8304dd68-f5a8-4fa5-b0ee-06cacfa4d5f8 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:58.698123 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-04084e5f-1313-4e62-bf8f-a5e396fc9450 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.727923 May 23 15:43:58.699574 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 163/339] 10.222.0.64 () {60 vars in 1146 bytes} [Mon May 23 15:43:57 2022] POST /compute/v2.1/servers => generated 408 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 15:43:58.714803 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-7d35b382-b2a8-44ba-ac85-d529410b9efd tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:58.715636 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-7d35b382-b2a8-44ba-ac85-d529410b9efd tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 15c3a3b9-3d55-44c3-8627-ba397c1f069d] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:58.789845 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-7d35b382-b2a8-44ba-ac85-d529410b9efd tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:58.795732 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-7d35b382-b2a8-44ba-ac85-d529410b9efd tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d" status: 200 len: 1246 microversion: 2.1 time: 0.089522 May 23 15:43:58.797135 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 164/340] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:58 2022] GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d => generated 1246 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:58.833658 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-8304dd68-f5a8-4fa5-b0ee-06cacfa4d5f8 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b983c0a2a124ac3aa3403e0777612f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0860b3d072246d49cd43a900351d571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:58.849635 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-8304dd68-f5a8-4fa5-b0ee-06cacfa4d5f8 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] 10.222.0.64 "GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb" status: 200 len: 1259 microversion: 2.1 time: 0.209505 May 23 15:43:58.849635 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 177/341] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:58 2022] GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb => generated 1259 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:43:58.894014 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-a0d26959-2ace-455b-9375-688d58cfb295 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:58.894879 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-a0d26959-2ace-455b-9375-688d58cfb295 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] [instance: ef32fe68-b121-4fdf-874b-db3e366da292] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:58.901598 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a0d26959-2ace-455b-9375-688d58cfb295 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:58.902765 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a0d26959-2ace-455b-9375-688d58cfb295 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:58.907293 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a0d26959-2ace-455b-9375-688d58cfb295 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:58.907293 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a0d26959-2ace-455b-9375-688d58cfb295 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:59.050503 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-a0d26959-2ace-455b-9375-688d58cfb295 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6badcf8b92dc43a3bc2342e303dec1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ef57ea448a49d3af268a02f6f08257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:59.055832 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-a0d26959-2ace-455b-9375-688d58cfb295 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] 10.222.0.64 "GET /compute/v2.1/servers/ef32fe68-b121-4fdf-874b-db3e366da292" status: 200 len: 1312 microversion: 2.1 time: 0.165530 May 23 15:43:59.056401 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 165/342] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:58 2022] GET /compute/v2.1/servers/ef32fe68-b121-4fdf-874b-db3e366da292 => generated 1312 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:59.295271 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-cd3887a6-48d4-4208-a0b5-8618a474a57a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:59.296180 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-cd3887a6-48d4-4208-a0b5-8618a474a57a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:59.303313 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-cd3887a6-48d4-4208-a0b5-8618a474a57a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:59.303758 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-cd3887a6-48d4-4208-a0b5-8618a474a57a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:59.304619 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-cd3887a6-48d4-4208-a0b5-8618a474a57a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:59.305081 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-cd3887a6-48d4-4208-a0b5-8618a474a57a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:59.341509 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_cell0:SELECT=16 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:43:59.442560 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-cd3887a6-48d4-4208-a0b5-8618a474a57a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:59.450703 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-cd3887a6-48d4-4208-a0b5-8618a474a57a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 200 len: 1722 microversion: 2.1 time: 0.159377 May 23 15:43:59.451266 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 178/343] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:59 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:43:59.814773 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-00d49ab0-7cc7-4993-910f-ba9530d78b01 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:59.815478 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-00d49ab0-7cc7-4993-910f-ba9530d78b01 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 15c3a3b9-3d55-44c3-8627-ba397c1f069d] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:59.822653 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-00d49ab0-7cc7-4993-910f-ba9530d78b01 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:59.823523 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-00d49ab0-7cc7-4993-910f-ba9530d78b01 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:59.824493 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-00d49ab0-7cc7-4993-910f-ba9530d78b01 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:59.824926 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-00d49ab0-7cc7-4993-910f-ba9530d78b01 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:59.865551 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-029c344a-be00-4d19-a148-ac114e738042 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:43:59.870928 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-029c344a-be00-4d19-a148-ac114e738042 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] [instance: dd66096c-0b64-4a26-bdec-1b1a46310cfb] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:43:59.881856 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-029c344a-be00-4d19-a148-ac114e738042 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:59.882556 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-029c344a-be00-4d19-a148-ac114e738042 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:59.883514 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-029c344a-be00-4d19-a148-ac114e738042 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:43:59.884111 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-029c344a-be00-4d19-a148-ac114e738042 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:43:59.900880 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-00d49ab0-7cc7-4993-910f-ba9530d78b01 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:43:59.908929 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-00d49ab0-7cc7-4993-910f-ba9530d78b01 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d" status: 200 len: 1250 microversion: 2.1 time: 0.098541 May 23 15:43:59.913096 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 166/344] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:59 2022] GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d => generated 1250 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:44:00.026460 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-029c344a-be00-4d19-a148-ac114e738042 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b983c0a2a124ac3aa3403e0777612f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0860b3d072246d49cd43a900351d571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:44:00.034013 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-029c344a-be00-4d19-a148-ac114e738042 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] 10.222.0.64 "GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb" status: 200 len: 1259 microversion: 2.1 time: 0.178252 May 23 15:44:00.034568 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 179/345] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:43:59 2022] GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb => generated 1259 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:44:00.072931 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-066f75dd-4dca-4802-8fa8-c6f12acf44a4 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:44:00.073702 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-066f75dd-4dca-4802-8fa8-c6f12acf44a4 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] [instance: ef32fe68-b121-4fdf-874b-db3e366da292] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:44:00.080068 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-066f75dd-4dca-4802-8fa8-c6f12acf44a4 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:00.080544 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-066f75dd-4dca-4802-8fa8-c6f12acf44a4 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:00.081299 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-066f75dd-4dca-4802-8fa8-c6f12acf44a4 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:00.081735 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-066f75dd-4dca-4802-8fa8-c6f12acf44a4 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:00.221776 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-066f75dd-4dca-4802-8fa8-c6f12acf44a4 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6badcf8b92dc43a3bc2342e303dec1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ef57ea448a49d3af268a02f6f08257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:44:00.232038 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-066f75dd-4dca-4802-8fa8-c6f12acf44a4 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] 10.222.0.64 "GET /compute/v2.1/servers/ef32fe68-b121-4fdf-874b-db3e366da292" status: 200 len: 1312 microversion: 2.1 time: 0.162881 May 23 15:44:00.232906 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 167/346] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:44:00 2022] GET /compute/v2.1/servers/ef32fe68-b121-4fdf-874b-db3e366da292 => generated 1312 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:44:00.468180 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-38bb0ce6-8a01-4284-b372-7ed99bb22065 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:44:00.468769 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-38bb0ce6-8a01-4284-b372-7ed99bb22065 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:44:00.470674 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:44:00.477019 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-38bb0ce6-8a01-4284-b372-7ed99bb22065 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:00.477507 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-38bb0ce6-8a01-4284-b372-7ed99bb22065 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:00.478313 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-38bb0ce6-8a01-4284-b372-7ed99bb22065 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:00.478770 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-38bb0ce6-8a01-4284-b372-7ed99bb22065 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:00.627294 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-38bb0ce6-8a01-4284-b372-7ed99bb22065 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:44:00.635720 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-38bb0ce6-8a01-4284-b372-7ed99bb22065 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 200 len: 1722 microversion: 2.1 time: 0.171530 May 23 15:44:00.636276 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 180/347] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:44:00 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:44:00.926770 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-aee444f4-703b-4d6b-a27f-fd561adb8b49 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:44:00.927384 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-aee444f4-703b-4d6b-a27f-fd561adb8b49 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 15c3a3b9-3d55-44c3-8627-ba397c1f069d] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:44:00.939318 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-aee444f4-703b-4d6b-a27f-fd561adb8b49 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:00.939318 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-aee444f4-703b-4d6b-a27f-fd561adb8b49 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:00.939318 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-aee444f4-703b-4d6b-a27f-fd561adb8b49 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:00.939318 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-aee444f4-703b-4d6b-a27f-fd561adb8b49 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:01.008194 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-aee444f4-703b-4d6b-a27f-fd561adb8b49 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:44:01.016417 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-aee444f4-703b-4d6b-a27f-fd561adb8b49 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d" status: 200 len: 1306 microversion: 2.1 time: 0.093525 May 23 15:44:01.017096 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 168/348] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:44:00 2022] GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d => generated 1306 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:44:01.051840 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-7753fe81-9466-4e8e-9906-3fd960fd1ea1 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:44:01.053236 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-7753fe81-9466-4e8e-9906-3fd960fd1ea1 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] [instance: dd66096c-0b64-4a26-bdec-1b1a46310cfb] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:44:01.059945 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-7753fe81-9466-4e8e-9906-3fd960fd1ea1 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:01.060408 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-7753fe81-9466-4e8e-9906-3fd960fd1ea1 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:01.061197 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-7753fe81-9466-4e8e-9906-3fd960fd1ea1 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:01.061640 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-7753fe81-9466-4e8e-9906-3fd960fd1ea1 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:01.206072 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-7753fe81-9466-4e8e-9906-3fd960fd1ea1 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b983c0a2a124ac3aa3403e0777612f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0860b3d072246d49cd43a900351d571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:44:01.212980 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-7753fe81-9466-4e8e-9906-3fd960fd1ea1 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] 10.222.0.64 "GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb" status: 200 len: 1259 microversion: 2.1 time: 0.165030 May 23 15:44:01.213588 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 181/349] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:44:01 2022] GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:44:01.249849 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-e44b1002-77b2-440b-8108-44a46489d57d tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:44:01.250691 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-e44b1002-77b2-440b-8108-44a46489d57d tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] [instance: ef32fe68-b121-4fdf-874b-db3e366da292] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:44:01.258786 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e44b1002-77b2-440b-8108-44a46489d57d tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:01.259249 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e44b1002-77b2-440b-8108-44a46489d57d tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:01.263351 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e44b1002-77b2-440b-8108-44a46489d57d tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:01.263351 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e44b1002-77b2-440b-8108-44a46489d57d tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:01.409270 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-e44b1002-77b2-440b-8108-44a46489d57d tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6badcf8b92dc43a3bc2342e303dec1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ef57ea448a49d3af268a02f6f08257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:44:01.417705 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-e44b1002-77b2-440b-8108-44a46489d57d tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] 10.222.0.64 "GET /compute/v2.1/servers/ef32fe68-b121-4fdf-874b-db3e366da292" status: 200 len: 1312 microversion: 2.1 time: 0.171990 May 23 15:44:01.418272 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 169/350] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:44:01 2022] GET /compute/v2.1/servers/ef32fe68-b121-4fdf-874b-db3e366da292 => generated 1312 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:44:01.654721 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-2a08741a-738b-43a7-a45e-3068cee6f6db tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:44:01.655345 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-2a08741a-738b-43a7-a45e-3068cee6f6db tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:44:01.662965 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2a08741a-738b-43a7-a45e-3068cee6f6db tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:01.663852 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2a08741a-738b-43a7-a45e-3068cee6f6db tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:01.665186 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2a08741a-738b-43a7-a45e-3068cee6f6db tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:01.665691 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2a08741a-738b-43a7-a45e-3068cee6f6db tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:01.802763 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-2a08741a-738b-43a7-a45e-3068cee6f6db tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:44:01.810568 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-2a08741a-738b-43a7-a45e-3068cee6f6db tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 200 len: 1722 microversion: 2.1 time: 0.161102 May 23 15:44:01.812159 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 182/351] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:44:01 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:44:02.036053 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-dc4651ac-be3a-4128-a3a9-2403a8586f85 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:44:02.036671 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-dc4651ac-be3a-4128-a3a9-2403a8586f85 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 15c3a3b9-3d55-44c3-8627-ba397c1f069d] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:44:02.049379 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-dc4651ac-be3a-4128-a3a9-2403a8586f85 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:02.049826 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-dc4651ac-be3a-4128-a3a9-2403a8586f85 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:02.050989 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-dc4651ac-be3a-4128-a3a9-2403a8586f85 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:02.051877 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-dc4651ac-be3a-4128-a3a9-2403a8586f85 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:02.232667 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-dc4651ac-be3a-4128-a3a9-2403a8586f85 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:44:02.233201 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-b679001a-0080-4372-a3a2-bf97052fa9c7 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:44:02.234373 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-b679001a-0080-4372-a3a2-bf97052fa9c7 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] [instance: dd66096c-0b64-4a26-bdec-1b1a46310cfb] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:44:02.242182 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-dc4651ac-be3a-4128-a3a9-2403a8586f85 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d" status: 200 len: 1371 microversion: 2.1 time: 0.210010 May 23 15:44:02.243341 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-b679001a-0080-4372-a3a2-bf97052fa9c7 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:02.244165 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-b679001a-0080-4372-a3a2-bf97052fa9c7 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:02.245131 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-b679001a-0080-4372-a3a2-bf97052fa9c7 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:02.245718 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-b679001a-0080-4372-a3a2-bf97052fa9c7 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:02.253492 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 170/352] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:44:02 2022] GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d => generated 1371 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:44:02.412910 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-b679001a-0080-4372-a3a2-bf97052fa9c7 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b983c0a2a124ac3aa3403e0777612f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0860b3d072246d49cd43a900351d571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:44:02.421803 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-b679001a-0080-4372-a3a2-bf97052fa9c7 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] 10.222.0.64 "GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb" status: 200 len: 1259 microversion: 2.1 time: 0.193061 May 23 15:44:02.429948 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 183/353] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:44:02 2022] GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb => generated 1259 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:44:02.437688 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-903a6591-b89f-4f01-9d22-4450b46c8269 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:44:02.438613 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-903a6591-b89f-4f01-9d22-4450b46c8269 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] [instance: ef32fe68-b121-4fdf-874b-db3e366da292] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:44:02.451317 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [req-2901d3a7-55e1-479b-b144-91dfd09d4cb9 req-84188a68-f682-465f-8cac-bf91ac1aec6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef32fe68-b121-4fdf-874b-db3e366da292", "name": "network-vif-plugged", "status": "completed", "tag": "8cb9cf89-cdd7-4d17-9a07-d6bba5ceb545"}]} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:44:02.462903 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-903a6591-b89f-4f01-9d22-4450b46c8269 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:02.463377 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-903a6591-b89f-4f01-9d22-4450b46c8269 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:02.464355 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-2901d3a7-55e1-479b-b144-91dfd09d4cb9 req-84188a68-f682-465f-8cac-bf91ac1aec6f service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:02.465034 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-2901d3a7-55e1-479b-b144-91dfd09d4cb9 req-84188a68-f682-465f-8cac-bf91ac1aec6f service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:02.465185 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-903a6591-b89f-4f01-9d22-4450b46c8269 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:02.465530 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-903a6591-b89f-4f01-9d22-4450b46c8269 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:02.482815 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.compute.server_external_events [req-2901d3a7-55e1-479b-b144-91dfd09d4cb9 req-84188a68-f682-465f-8cac-bf91ac1aec6f service nova] Creating event network-vif-plugged:8cb9cf89-cdd7-4d17-9a07-d6bba5ceb545 for instance ef32fe68-b121-4fdf-874b-db3e366da292 on hv-cinder-84067 May 23 15:44:02.489374 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [req-2901d3a7-55e1-479b-b144-91dfd09d4cb9 req-84188a68-f682-465f-8cac-bf91ac1aec6f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041189 May 23 15:44:02.495516 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 184/354] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:44:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:44:02.610289 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-903a6591-b89f-4f01-9d22-4450b46c8269 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6badcf8b92dc43a3bc2342e303dec1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ef57ea448a49d3af268a02f6f08257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:44:02.617943 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-903a6591-b89f-4f01-9d22-4450b46c8269 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] 10.222.0.64 "GET /compute/v2.1/servers/ef32fe68-b121-4fdf-874b-db3e366da292" status: 200 len: 1312 microversion: 2.1 time: 0.184477 May 23 15:44:02.618983 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 171/355] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:44:02 2022] GET /compute/v2.1/servers/ef32fe68-b121-4fdf-874b-db3e366da292 => generated 1312 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:44:02.828636 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-49bd7dba-f5c1-41ed-9e5e-2b6b5f363241 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:44:02.829262 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-49bd7dba-f5c1-41ed-9e5e-2b6b5f363241 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:44:02.837544 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-49bd7dba-f5c1-41ed-9e5e-2b6b5f363241 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:02.838067 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-49bd7dba-f5c1-41ed-9e5e-2b6b5f363241 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:02.838849 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-49bd7dba-f5c1-41ed-9e5e-2b6b5f363241 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:02.839287 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-49bd7dba-f5c1-41ed-9e5e-2b6b5f363241 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:03.004378 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [req-9b859c12-813e-4afd-becb-7144266417ec req-38de8a65-ca6b-4529-b58b-400a02daa055 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15c3a3b9-3d55-44c3-8627-ba397c1f069d", "tag": "f835d7e4-2023-42a3-91c1-27e29436c365"}]} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:44:03.014386 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-9b859c12-813e-4afd-becb-7144266417ec req-38de8a65-ca6b-4529-b58b-400a02daa055 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:03.015815 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-9b859c12-813e-4afd-becb-7144266417ec req-38de8a65-ca6b-4529-b58b-400a02daa055 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:03.029477 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.compute.server_external_events [req-9b859c12-813e-4afd-becb-7144266417ec req-38de8a65-ca6b-4529-b58b-400a02daa055 service nova] Creating event network-changed:f835d7e4-2023-42a3-91c1-27e29436c365 for instance 15c3a3b9-3d55-44c3-8627-ba397c1f069d on hv-cinder-84067 May 23 15:44:03.034645 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [req-9b859c12-813e-4afd-becb-7144266417ec req-38de8a65-ca6b-4529-b58b-400a02daa055 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035465 May 23 15:44:03.036001 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 172/356] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:44:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:44:03.043022 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-49bd7dba-f5c1-41ed-9e5e-2b6b5f363241 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:44:03.052679 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-49bd7dba-f5c1-41ed-9e5e-2b6b5f363241 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 200 len: 1722 microversion: 2.1 time: 0.228398 May 23 15:44:03.060930 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 185/357] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:44:02 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 1722 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:44:03.260801 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-5ce009af-d48e-40f7-9ded-a925bd34a316 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:44:03.261570 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-5ce009af-d48e-40f7-9ded-a925bd34a316 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 15c3a3b9-3d55-44c3-8627-ba397c1f069d] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:44:03.267755 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-5ce009af-d48e-40f7-9ded-a925bd34a316 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:03.268203 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-5ce009af-d48e-40f7-9ded-a925bd34a316 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:03.269008 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-5ce009af-d48e-40f7-9ded-a925bd34a316 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:03.269523 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-5ce009af-d48e-40f7-9ded-a925bd34a316 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:03.407876 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-5ce009af-d48e-40f7-9ded-a925bd34a316 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:44:03.415277 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-5ce009af-d48e-40f7-9ded-a925bd34a316 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d" status: 200 len: 1371 microversion: 2.1 time: 0.158735 May 23 15:44:03.415851 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 173/358] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:44:03 2022] GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:44:03.438777 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-8f439020-cd73-4e03-a909-3e988714aed0 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:44:03.439424 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-8f439020-cd73-4e03-a909-3e988714aed0 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] [instance: dd66096c-0b64-4a26-bdec-1b1a46310cfb] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:44:03.446083 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-8f439020-cd73-4e03-a909-3e988714aed0 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:03.446481 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-8f439020-cd73-4e03-a909-3e988714aed0 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:03.447251 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-8f439020-cd73-4e03-a909-3e988714aed0 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:03.447702 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-8f439020-cd73-4e03-a909-3e988714aed0 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:03.583865 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-8f439020-cd73-4e03-a909-3e988714aed0 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b983c0a2a124ac3aa3403e0777612f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0860b3d072246d49cd43a900351d571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:44:03.592333 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-8f439020-cd73-4e03-a909-3e988714aed0 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] 10.222.0.64 "GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb" status: 200 len: 1259 microversion: 2.1 time: 0.157412 May 23 15:44:03.592898 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 186/359] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:44:03 2022] GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:44:03.634806 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-c224bff5-d417-49eb-ba89-b677582d9602 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:44:03.635439 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-c224bff5-d417-49eb-ba89-b677582d9602 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] [instance: ef32fe68-b121-4fdf-874b-db3e366da292] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:44:03.641890 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c224bff5-d417-49eb-ba89-b677582d9602 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:03.642353 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c224bff5-d417-49eb-ba89-b677582d9602 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:03.643127 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c224bff5-d417-49eb-ba89-b677582d9602 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:03.643571 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c224bff5-d417-49eb-ba89-b677582d9602 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:03.773020 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-c224bff5-d417-49eb-ba89-b677582d9602 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6badcf8b92dc43a3bc2342e303dec1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ef57ea448a49d3af268a02f6f08257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:44:03.776523 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_cell1:SELECT=100 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:44:03.780967 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-c224bff5-d417-49eb-ba89-b677582d9602 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] 10.222.0.64 "GET /compute/v2.1/servers/ef32fe68-b121-4fdf-874b-db3e366da292" status: 200 len: 1312 microversion: 2.1 time: 0.149976 May 23 15:44:03.781568 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 174/360] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:44:03 2022] GET /compute/v2.1/servers/ef32fe68-b121-4fdf-874b-db3e366da292 => generated 1312 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:44:04.069925 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-6b5f7780-4419-48c0-b7b4-33e2c702123c tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:44:04.070578 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-6b5f7780-4419-48c0-b7b4-33e2c702123c tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:44:04.077608 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-6b5f7780-4419-48c0-b7b4-33e2c702123c tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:04.078067 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-6b5f7780-4419-48c0-b7b4-33e2c702123c tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:04.079032 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-6b5f7780-4419-48c0-b7b4-33e2c702123c tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:04.079635 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-6b5f7780-4419-48c0-b7b4-33e2c702123c tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:04.296782 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-6b5f7780-4419-48c0-b7b4-33e2c702123c tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:44:04.305132 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-6b5f7780-4419-48c0-b7b4-33e2c702123c tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 200 len: 1722 microversion: 2.1 time: 0.239342 May 23 15:44:04.305751 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 187/361] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:44:04 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 1722 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:44:04.432448 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-0cae6a94-7c8f-4a7c-8cd2-e0ba2239c22d tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:44:04.433053 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-0cae6a94-7c8f-4a7c-8cd2-e0ba2239c22d tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 15c3a3b9-3d55-44c3-8627-ba397c1f069d] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:44:04.435285 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:44:04.440077 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-0cae6a94-7c8f-4a7c-8cd2-e0ba2239c22d tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:04.440529 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-0cae6a94-7c8f-4a7c-8cd2-e0ba2239c22d tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:04.441340 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-0cae6a94-7c8f-4a7c-8cd2-e0ba2239c22d tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:04.441812 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-0cae6a94-7c8f-4a7c-8cd2-e0ba2239c22d tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:04.575169 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-0cae6a94-7c8f-4a7c-8cd2-e0ba2239c22d tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:44:04.582473 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-0cae6a94-7c8f-4a7c-8cd2-e0ba2239c22d tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d" status: 200 len: 1371 microversion: 2.1 time: 0.154042 May 23 15:44:04.583025 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 175/362] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:44:04 2022] GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:44:04.609646 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-4643b035-c14c-4d7c-8157-55be3170bac8 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:44:04.610266 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-4643b035-c14c-4d7c-8157-55be3170bac8 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] [instance: dd66096c-0b64-4a26-bdec-1b1a46310cfb] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:44:04.616872 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4643b035-c14c-4d7c-8157-55be3170bac8 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:04.617340 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4643b035-c14c-4d7c-8157-55be3170bac8 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:04.618108 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4643b035-c14c-4d7c-8157-55be3170bac8 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:04.618548 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4643b035-c14c-4d7c-8157-55be3170bac8 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:04.748890 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-4643b035-c14c-4d7c-8157-55be3170bac8 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b983c0a2a124ac3aa3403e0777612f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0860b3d072246d49cd43a900351d571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:44:04.756448 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-4643b035-c14c-4d7c-8157-55be3170bac8 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] 10.222.0.64 "GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb" status: 200 len: 1259 microversion: 2.1 time: 0.150563 May 23 15:44:04.757011 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 188/363] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:44:04 2022] GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:44:04.798517 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-3f2da628-16a6-4b67-9f3a-c115962e78b1 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:44:04.799126 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-3f2da628-16a6-4b67-9f3a-c115962e78b1 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] [instance: ef32fe68-b121-4fdf-874b-db3e366da292] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:44:04.805805 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-3f2da628-16a6-4b67-9f3a-c115962e78b1 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:04.806251 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-3f2da628-16a6-4b67-9f3a-c115962e78b1 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:04.807013 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-3f2da628-16a6-4b67-9f3a-c115962e78b1 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:04.807444 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-3f2da628-16a6-4b67-9f3a-c115962e78b1 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:04.941418 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-3f2da628-16a6-4b67-9f3a-c115962e78b1 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6badcf8b92dc43a3bc2342e303dec1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ef57ea448a49d3af268a02f6f08257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:44:04.948965 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-3f2da628-16a6-4b67-9f3a-c115962e78b1 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] 10.222.0.64 "GET /compute/v2.1/servers/ef32fe68-b121-4fdf-874b-db3e366da292" status: 200 len: 1312 microversion: 2.1 time: 0.154708 May 23 15:44:04.949548 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 176/364] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:44:04 2022] GET /compute/v2.1/servers/ef32fe68-b121-4fdf-874b-db3e366da292 => generated 1312 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:44:05.323185 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-34f0fb0e-8604-47ae-8064-cbb825456145 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:44:05.323793 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-34f0fb0e-8604-47ae-8064-cbb825456145 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:44:05.329822 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-34f0fb0e-8604-47ae-8064-cbb825456145 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:05.330275 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-34f0fb0e-8604-47ae-8064-cbb825456145 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:05.331038 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-34f0fb0e-8604-47ae-8064-cbb825456145 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:05.331479 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-34f0fb0e-8604-47ae-8064-cbb825456145 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:05.474084 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-34f0fb0e-8604-47ae-8064-cbb825456145 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:44:05.481986 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-34f0fb0e-8604-47ae-8064-cbb825456145 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 200 len: 1722 microversion: 2.1 time: 0.162673 May 23 15:44:05.482553 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 189/365] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:44:05 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:44:05.600810 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-925d1bfb-9d88-4196-ab10-3ecc76a77472 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:44:05.603015 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-925d1bfb-9d88-4196-ab10-3ecc76a77472 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 15c3a3b9-3d55-44c3-8627-ba397c1f069d] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:44:05.607660 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-925d1bfb-9d88-4196-ab10-3ecc76a77472 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:05.608119 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-925d1bfb-9d88-4196-ab10-3ecc76a77472 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:05.608893 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-925d1bfb-9d88-4196-ab10-3ecc76a77472 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:05.609389 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-925d1bfb-9d88-4196-ab10-3ecc76a77472 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:05.744023 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-925d1bfb-9d88-4196-ab10-3ecc76a77472 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:44:05.751467 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-925d1bfb-9d88-4196-ab10-3ecc76a77472 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d" status: 200 len: 1371 microversion: 2.1 time: 0.156249 May 23 15:44:05.752033 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 177/366] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:44:05 2022] GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:44:05.773078 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-b35c1494-6461-4ccf-a6bd-77bc46dff813 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:44:05.773772 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-b35c1494-6461-4ccf-a6bd-77bc46dff813 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] [instance: dd66096c-0b64-4a26-bdec-1b1a46310cfb] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:44:05.779819 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-b35c1494-6461-4ccf-a6bd-77bc46dff813 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:05.783404 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-b35c1494-6461-4ccf-a6bd-77bc46dff813 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:05.783404 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-b35c1494-6461-4ccf-a6bd-77bc46dff813 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:05.783404 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-b35c1494-6461-4ccf-a6bd-77bc46dff813 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:05.915713 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-b35c1494-6461-4ccf-a6bd-77bc46dff813 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b983c0a2a124ac3aa3403e0777612f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0860b3d072246d49cd43a900351d571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:44:05.923850 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-b35c1494-6461-4ccf-a6bd-77bc46dff813 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] 10.222.0.64 "GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb" status: 200 len: 1259 microversion: 2.1 time: 0.155354 May 23 15:44:05.924416 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 190/367] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:44:05 2022] GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:44:05.966281 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-ba86114e-1de8-42bb-b081-518a54546dab tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:44:05.966895 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-ba86114e-1de8-42bb-b081-518a54546dab tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] [instance: ef32fe68-b121-4fdf-874b-db3e366da292] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:44:05.974524 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ba86114e-1de8-42bb-b081-518a54546dab tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:05.974976 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ba86114e-1de8-42bb-b081-518a54546dab tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:05.975746 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ba86114e-1de8-42bb-b081-518a54546dab tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:05.976210 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ba86114e-1de8-42bb-b081-518a54546dab tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:06.109712 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-ba86114e-1de8-42bb-b081-518a54546dab tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6badcf8b92dc43a3bc2342e303dec1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ef57ea448a49d3af268a02f6f08257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:44:06.118030 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-ba86114e-1de8-42bb-b081-518a54546dab tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] 10.222.0.64 "GET /compute/v2.1/servers/ef32fe68-b121-4fdf-874b-db3e366da292" status: 200 len: 1496 microversion: 2.1 time: 0.155557 May 23 15:44:06.118859 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 178/368] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:44:05 2022] GET /compute/v2.1/servers/ef32fe68-b121-4fdf-874b-db3e366da292 => generated 1496 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:44:06.499830 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-8f917363-71ca-4356-bf85-f6b165899e6b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:44:06.500439 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-8f917363-71ca-4356-bf85-f6b165899e6b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:44:06.507097 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-8f917363-71ca-4356-bf85-f6b165899e6b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:06.507549 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-8f917363-71ca-4356-bf85-f6b165899e6b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:06.508316 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-8f917363-71ca-4356-bf85-f6b165899e6b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:06.508796 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-8f917363-71ca-4356-bf85-f6b165899e6b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:06.527440 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_cell1:SELECT=100 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:44:06.730951 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-8f917363-71ca-4356-bf85-f6b165899e6b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:44:06.740753 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-8f917363-71ca-4356-bf85-f6b165899e6b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 200 len: 1722 microversion: 2.1 time: 0.244816 May 23 15:44:06.742384 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 191/369] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:44:06 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 1722 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:44:06.768686 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-e3bbf794-35f1-4336-bc84-58a0407b38e2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:44:06.769598 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-e3bbf794-35f1-4336-bc84-58a0407b38e2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 15c3a3b9-3d55-44c3-8627-ba397c1f069d] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:44:06.775631 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e3bbf794-35f1-4336-bc84-58a0407b38e2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:06.776288 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e3bbf794-35f1-4336-bc84-58a0407b38e2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:06.777433 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e3bbf794-35f1-4336-bc84-58a0407b38e2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:06.778026 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e3bbf794-35f1-4336-bc84-58a0407b38e2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:06.943851 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-ef43c3d4-e635-47e9-9e1f-5a05aa3ed2c9 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:44:06.944605 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-ef43c3d4-e635-47e9-9e1f-5a05aa3ed2c9 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] [instance: dd66096c-0b64-4a26-bdec-1b1a46310cfb] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:44:06.950792 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ef43c3d4-e635-47e9-9e1f-5a05aa3ed2c9 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:06.951241 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ef43c3d4-e635-47e9-9e1f-5a05aa3ed2c9 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:06.952329 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ef43c3d4-e635-47e9-9e1f-5a05aa3ed2c9 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:06.952766 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ef43c3d4-e635-47e9-9e1f-5a05aa3ed2c9 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:07.230146 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-e3bbf794-35f1-4336-bc84-58a0407b38e2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:44:07.244954 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-e3bbf794-35f1-4336-bc84-58a0407b38e2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d" status: 200 len: 1371 microversion: 2.1 time: 0.480281 May 23 15:44:07.245563 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 179/370] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:44:06 2022] GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d => generated 1371 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:44:07.252296 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-726a389c-2328-495b-a3e9-ab35248f74f8 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:44:07.253003 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-726a389c-2328-495b-a3e9-ab35248f74f8 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] [instance: ef32fe68-b121-4fdf-874b-db3e366da292] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:44:07.260217 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-726a389c-2328-495b-a3e9-ab35248f74f8 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:07.260983 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-726a389c-2328-495b-a3e9-ab35248f74f8 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:07.261459 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-726a389c-2328-495b-a3e9-ab35248f74f8 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:07.262083 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-726a389c-2328-495b-a3e9-ab35248f74f8 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:07.273617 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-ef43c3d4-e635-47e9-9e1f-5a05aa3ed2c9 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b983c0a2a124ac3aa3403e0777612f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0860b3d072246d49cd43a900351d571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:44:07.281991 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-ef43c3d4-e635-47e9-9e1f-5a05aa3ed2c9 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] 10.222.0.64 "GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb" status: 200 len: 1259 microversion: 2.1 time: 0.341991 May 23 15:44:07.282668 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 192/371] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:44:06 2022] GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb => generated 1259 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:44:07.288912 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-726a389c-2328-495b-a3e9-ab35248f74f8 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] [instance: ef32fe68-b121-4fdf-874b-db3e366da292] Going to try to terminate instance {{(pid=124933) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 15:44:07.671658 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-726a389c-2328-495b-a3e9-ab35248f74f8 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] 10.222.0.64 "DELETE /compute/v2.1/servers/ef32fe68-b121-4fdf-874b-db3e366da292" status: 204 len: 0 microversion: 2.1 time: 0.423502 May 23 15:44:07.672359 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 180/372] 10.222.0.64 () {58 vars in 1238 bytes} [Mon May 23 15:44:07 2022] DELETE /compute/v2.1/servers/ef32fe68-b121-4fdf-874b-db3e366da292 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 15:44:07.687005 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-4968a169-8898-438c-b0f7-ac1caf7aac38 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:44:07.687612 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-4968a169-8898-438c-b0f7-ac1caf7aac38 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] [instance: ef32fe68-b121-4fdf-874b-db3e366da292] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:44:07.693578 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4968a169-8898-438c-b0f7-ac1caf7aac38 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:07.694030 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4968a169-8898-438c-b0f7-ac1caf7aac38 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:07.694798 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4968a169-8898-438c-b0f7-ac1caf7aac38 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:07.695235 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4968a169-8898-438c-b0f7-ac1caf7aac38 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:07.762152 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-e3a98911-935c-41d0-87c2-5315133c86ab tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:44:07.762152 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-e3a98911-935c-41d0-87c2-5315133c86ab tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:44:07.767567 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e3a98911-935c-41d0-87c2-5315133c86ab tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:07.768214 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e3a98911-935c-41d0-87c2-5315133c86ab tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:07.769730 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e3a98911-935c-41d0-87c2-5315133c86ab tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:07.770978 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e3a98911-935c-41d0-87c2-5315133c86ab tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:07.864539 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-4968a169-8898-438c-b0f7-ac1caf7aac38 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6badcf8b92dc43a3bc2342e303dec1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ef57ea448a49d3af268a02f6f08257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:44:07.874420 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-4968a169-8898-438c-b0f7-ac1caf7aac38 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] 10.222.0.64 "GET /compute/v2.1/servers/ef32fe68-b121-4fdf-874b-db3e366da292" status: 200 len: 1502 microversion: 2.1 time: 0.189882 May 23 15:44:07.874420 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 193/373] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:44:07 2022] GET /compute/v2.1/servers/ef32fe68-b121-4fdf-874b-db3e366da292 => generated 1502 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:44:07.922134 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-e3a98911-935c-41d0-87c2-5315133c86ab tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:44:07.930263 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-e3a98911-935c-41d0-87c2-5315133c86ab tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 200 len: 1722 microversion: 2.1 time: 0.174870 May 23 15:44:07.930827 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 181/374] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:44:07 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:44:08.263060 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-96508da8-e9e4-4939-87fb-8494733dcdfe tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:44:08.263810 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-96508da8-e9e4-4939-87fb-8494733dcdfe tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 15c3a3b9-3d55-44c3-8627-ba397c1f069d] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:44:08.270474 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-96508da8-e9e4-4939-87fb-8494733dcdfe tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:08.271104 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-96508da8-e9e4-4939-87fb-8494733dcdfe tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:08.271944 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-96508da8-e9e4-4939-87fb-8494733dcdfe tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:08.272392 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-96508da8-e9e4-4939-87fb-8494733dcdfe tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:08.306101 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-82e30094-520a-4745-9067-82c08b302911 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:44:08.307123 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-82e30094-520a-4745-9067-82c08b302911 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] [instance: dd66096c-0b64-4a26-bdec-1b1a46310cfb] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:44:08.333874 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-82e30094-520a-4745-9067-82c08b302911 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:08.334284 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-82e30094-520a-4745-9067-82c08b302911 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:08.335125 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-82e30094-520a-4745-9067-82c08b302911 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:08.335579 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-82e30094-520a-4745-9067-82c08b302911 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:08.502592 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-96508da8-e9e4-4939-87fb-8494733dcdfe tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:44:08.510417 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-96508da8-e9e4-4939-87fb-8494733dcdfe tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d" status: 200 len: 1371 microversion: 2.1 time: 0.251134 May 23 15:44:08.511668 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 194/375] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:44:08 2022] GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d => generated 1371 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:44:08.537087 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-82e30094-520a-4745-9067-82c08b302911 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b983c0a2a124ac3aa3403e0777612f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0860b3d072246d49cd43a900351d571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:44:08.544484 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-82e30094-520a-4745-9067-82c08b302911 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] 10.222.0.64 "GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb" status: 200 len: 1259 microversion: 2.1 time: 0.250023 May 23 15:44:08.545069 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 182/376] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:44:08 2022] GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb => generated 1259 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:44:08.889954 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-339456bb-a5c6-4838-93ca-9d80df48ff3d tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:44:08.890646 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-339456bb-a5c6-4838-93ca-9d80df48ff3d tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] [instance: ef32fe68-b121-4fdf-874b-db3e366da292] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:44:08.897426 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-339456bb-a5c6-4838-93ca-9d80df48ff3d tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:08.897880 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-339456bb-a5c6-4838-93ca-9d80df48ff3d tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:08.898639 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-339456bb-a5c6-4838-93ca-9d80df48ff3d tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:08.899079 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-339456bb-a5c6-4838-93ca-9d80df48ff3d tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:08.947877 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-fa652884-3cf1-4c5a-af35-e70df6a9685c tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:44:08.948624 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-fa652884-3cf1-4c5a-af35-e70df6a9685c tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:44:08.950579 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_cell0:SELECT=2 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:44:08.951300 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_cell0:SELECT=12 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:44:08.956232 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-fa652884-3cf1-4c5a-af35-e70df6a9685c tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:08.957606 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-fa652884-3cf1-4c5a-af35-e70df6a9685c tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:08.958354 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-fa652884-3cf1-4c5a-af35-e70df6a9685c tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:08.958792 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-fa652884-3cf1-4c5a-af35-e70df6a9685c tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:09.092437 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-339456bb-a5c6-4838-93ca-9d80df48ff3d tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6badcf8b92dc43a3bc2342e303dec1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ef57ea448a49d3af268a02f6f08257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:44:09.103664 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-339456bb-a5c6-4838-93ca-9d80df48ff3d tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] 10.222.0.64 "GET /compute/v2.1/servers/ef32fe68-b121-4fdf-874b-db3e366da292" status: 200 len: 1502 microversion: 2.1 time: 0.215288 May 23 15:44:09.110969 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 195/377] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:44:08 2022] GET /compute/v2.1/servers/ef32fe68-b121-4fdf-874b-db3e366da292 => generated 1502 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:44:09.133081 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-fa652884-3cf1-4c5a-af35-e70df6a9685c tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:44:09.141206 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-fa652884-3cf1-4c5a-af35-e70df6a9685c tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 200 len: 1699 microversion: 2.1 time: 0.197212 May 23 15:44:09.141900 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 183/378] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:44:08 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 1699 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:44:09.158285 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-e4458645-351e-4a1d-8d72-c78317306150 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:44:09.164832 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e4458645-351e-4a1d-8d72-c78317306150 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:09.165317 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e4458645-351e-4a1d-8d72-c78317306150 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:09.224952 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-e4458645-351e-4a1d-8d72-c78317306150 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Going to try to start instance {{(pid=124934) start /opt/stack/nova/nova/compute/api.py:2730}} May 23 15:44:09.457372 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-e4458645-351e-4a1d-8d72-c78317306150 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "POST /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358/action" status: 202 len: 0 microversion: 2.1 time: 0.302155 May 23 15:44:09.457974 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 196/379] 10.222.0.64 () {60 vars in 1277 bytes} [Mon May 23 15:44:09 2022] POST /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 15:44:09.465977 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-c6b39baf-141d-4b71-bc13-da49af77a127 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:44:09.466628 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-c6b39baf-141d-4b71-bc13-da49af77a127 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:44:09.474189 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c6b39baf-141d-4b71-bc13-da49af77a127 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:09.474642 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c6b39baf-141d-4b71-bc13-da49af77a127 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:09.480126 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c6b39baf-141d-4b71-bc13-da49af77a127 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:09.480126 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c6b39baf-141d-4b71-bc13-da49af77a127 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:09.528044 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-7edec870-a875-4cd9-8097-e496f5544df1 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:44:09.528739 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-7edec870-a875-4cd9-8097-e496f5544df1 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 15c3a3b9-3d55-44c3-8627-ba397c1f069d] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:44:09.538700 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-7edec870-a875-4cd9-8097-e496f5544df1 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:09.539150 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-7edec870-a875-4cd9-8097-e496f5544df1 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:09.539903 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-7edec870-a875-4cd9-8097-e496f5544df1 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:09.540350 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-7edec870-a875-4cd9-8097-e496f5544df1 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:09.705379 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-c6b39baf-141d-4b71-bc13-da49af77a127 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:44:09.714557 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-c6b39baf-141d-4b71-bc13-da49af77a127 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 200 len: 1708 microversion: 2.1 time: 0.252282 May 23 15:44:09.715777 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 184/380] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:44:09 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 1708 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:44:09.720866 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-3faf7a59-9573-4d4c-b624-5eb8a608a735 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:44:09.721912 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-3faf7a59-9573-4d4c-b624-5eb8a608a735 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] [instance: dd66096c-0b64-4a26-bdec-1b1a46310cfb] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:44:09.728856 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-3faf7a59-9573-4d4c-b624-5eb8a608a735 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:09.729584 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-3faf7a59-9573-4d4c-b624-5eb8a608a735 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:09.730368 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-3faf7a59-9573-4d4c-b624-5eb8a608a735 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:09.730810 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-3faf7a59-9573-4d4c-b624-5eb8a608a735 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:09.737197 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-7edec870-a875-4cd9-8097-e496f5544df1 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:44:09.744876 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-7edec870-a875-4cd9-8097-e496f5544df1 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d" status: 200 len: 1371 microversion: 2.1 time: 0.220949 May 23 15:44:09.745557 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 197/381] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:44:09 2022] GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d => generated 1371 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:44:09.865641 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-3faf7a59-9573-4d4c-b624-5eb8a608a735 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b983c0a2a124ac3aa3403e0777612f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0860b3d072246d49cd43a900351d571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:44:09.873014 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-3faf7a59-9573-4d4c-b624-5eb8a608a735 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] 10.222.0.64 "GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb" status: 200 len: 1259 microversion: 2.1 time: 0.156462 May 23 15:44:09.873624 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 185/382] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:44:09 2022] GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:44:10.118756 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-0dacf067-f249-442d-b656-3e4ab4148ad2 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:44:10.119510 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-0dacf067-f249-442d-b656-3e4ab4148ad2 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] [instance: ef32fe68-b121-4fdf-874b-db3e366da292] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:44:10.127699 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0dacf067-f249-442d-b656-3e4ab4148ad2 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:10.128251 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0dacf067-f249-442d-b656-3e4ab4148ad2 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:10.129959 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0dacf067-f249-442d-b656-3e4ab4148ad2 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:10.130212 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0dacf067-f249-442d-b656-3e4ab4148ad2 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:10.267161 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-0dacf067-f249-442d-b656-3e4ab4148ad2 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6badcf8b92dc43a3bc2342e303dec1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ef57ea448a49d3af268a02f6f08257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:44:10.275652 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-0dacf067-f249-442d-b656-3e4ab4148ad2 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] 10.222.0.64 "GET /compute/v2.1/servers/ef32fe68-b121-4fdf-874b-db3e366da292" status: 200 len: 1502 microversion: 2.1 time: 0.160728 May 23 15:44:10.276455 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 198/383] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:44:10 2022] GET /compute/v2.1/servers/ef32fe68-b121-4fdf-874b-db3e366da292 => generated 1502 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:44:10.615903 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [req-1148430e-27e4-4834-9344-761537103eed req-6633857d-5ee9-4a32-b77c-d346c662359f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd66096c-0b64-4a26-bdec-1b1a46310cfb", "name": "network-vif-plugged", "status": "completed", "tag": "a0610243-2466-4315-a3e6-15f6cea816b8"}]} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:44:10.626596 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-1148430e-27e4-4834-9344-761537103eed req-6633857d-5ee9-4a32-b77c-d346c662359f service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:10.627881 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-1148430e-27e4-4834-9344-761537103eed req-6633857d-5ee9-4a32-b77c-d346c662359f service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:10.642923 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.compute.server_external_events [req-1148430e-27e4-4834-9344-761537103eed req-6633857d-5ee9-4a32-b77c-d346c662359f service nova] Creating event network-vif-plugged:a0610243-2466-4315-a3e6-15f6cea816b8 for instance dd66096c-0b64-4a26-bdec-1b1a46310cfb on hv-cinder-84067 May 23 15:44:10.649626 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [req-1148430e-27e4-4834-9344-761537103eed req-6633857d-5ee9-4a32-b77c-d346c662359f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038504 May 23 15:44:10.652208 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 186/384] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:44:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:44:10.735571 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-938dda3f-7d18-4af1-b5bb-bff89ad4c160 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:44:10.739806 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-938dda3f-7d18-4af1-b5bb-bff89ad4c160 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:44:10.752465 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-938dda3f-7d18-4af1-b5bb-bff89ad4c160 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:10.753014 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-938dda3f-7d18-4af1-b5bb-bff89ad4c160 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:10.755153 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-938dda3f-7d18-4af1-b5bb-bff89ad4c160 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:10.755762 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-938dda3f-7d18-4af1-b5bb-bff89ad4c160 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:10.762270 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-7ff0256e-1168-42e0-b063-dce4430d5f12 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:44:10.763109 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-7ff0256e-1168-42e0-b063-dce4430d5f12 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 15c3a3b9-3d55-44c3-8627-ba397c1f069d] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:44:10.769870 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-7ff0256e-1168-42e0-b063-dce4430d5f12 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:10.770450 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-7ff0256e-1168-42e0-b063-dce4430d5f12 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:10.771139 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-7ff0256e-1168-42e0-b063-dce4430d5f12 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:10.771572 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-7ff0256e-1168-42e0-b063-dce4430d5f12 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:11.051500 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-938dda3f-7d18-4af1-b5bb-bff89ad4c160 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:44:11.088868 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-938dda3f-7d18-4af1-b5bb-bff89ad4c160 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 200 len: 1708 microversion: 2.1 time: 0.357858 May 23 15:44:11.104776 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-7ff0256e-1168-42e0-b063-dce4430d5f12 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:44:11.112846 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-7ff0256e-1168-42e0-b063-dce4430d5f12 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d" status: 200 len: 1371 microversion: 2.1 time: 0.354564 May 23 15:44:11.113444 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 187/385] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:44:10 2022] GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d => generated 1371 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:44:11.113686 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 199/386] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:44:10 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 1708 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:44:11.118977 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-ef2464b4-cdd4-4778-89d7-24d2674972d3 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:44:11.119866 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-ef2464b4-cdd4-4778-89d7-24d2674972d3 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] [instance: dd66096c-0b64-4a26-bdec-1b1a46310cfb] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:44:11.128974 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ef2464b4-cdd4-4778-89d7-24d2674972d3 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:11.129705 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ef2464b4-cdd4-4778-89d7-24d2674972d3 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:11.130495 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ef2464b4-cdd4-4778-89d7-24d2674972d3 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:11.130937 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ef2464b4-cdd4-4778-89d7-24d2674972d3 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:11.296985 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-cd1c4aac-8737-496b-9b9b-707c4353e004 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:44:11.303039 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-cd1c4aac-8737-496b-9b9b-707c4353e004 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] [instance: ef32fe68-b121-4fdf-874b-db3e366da292] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:44:11.306527 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-cd1c4aac-8737-496b-9b9b-707c4353e004 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:11.307534 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-cd1c4aac-8737-496b-9b9b-707c4353e004 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:11.308670 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-cd1c4aac-8737-496b-9b9b-707c4353e004 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:11.309628 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-cd1c4aac-8737-496b-9b9b-707c4353e004 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:11.366038 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-ef2464b4-cdd4-4778-89d7-24d2674972d3 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b983c0a2a124ac3aa3403e0777612f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0860b3d072246d49cd43a900351d571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:44:11.376688 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-ef2464b4-cdd4-4778-89d7-24d2674972d3 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] 10.222.0.64 "GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb" status: 200 len: 1259 microversion: 2.1 time: 0.261758 May 23 15:44:11.377283 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 200/387] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:44:11 2022] GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb => generated 1259 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:44:11.423842 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-cd1c4aac-8737-496b-9b9b-707c4353e004 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6badcf8b92dc43a3bc2342e303dec1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ef57ea448a49d3af268a02f6f08257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:44:11.434119 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-cd1c4aac-8737-496b-9b9b-707c4353e004 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] 10.222.0.64 "GET /compute/v2.1/servers/ef32fe68-b121-4fdf-874b-db3e366da292" status: 200 len: 1460 microversion: 2.1 time: 0.144060 May 23 15:44:11.434975 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 188/388] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:44:11 2022] GET /compute/v2.1/servers/ef32fe68-b121-4fdf-874b-db3e366da292 => generated 1460 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:44:11.471154 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [req-bc32ea6e-7ee1-468c-8204-15fca94309b4 req-c2325589-690e-4d5a-ab41-24d3548edbfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef32fe68-b121-4fdf-874b-db3e366da292", "name": "network-vif-deleted", "tag": "8cb9cf89-cdd7-4d17-9a07-d6bba5ceb545"}]} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:44:11.480201 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-bc32ea6e-7ee1-468c-8204-15fca94309b4 req-c2325589-690e-4d5a-ab41-24d3548edbfd service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:11.480738 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-bc32ea6e-7ee1-468c-8204-15fca94309b4 req-c2325589-690e-4d5a-ab41-24d3548edbfd service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:11.491483 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.compute.server_external_events [req-bc32ea6e-7ee1-468c-8204-15fca94309b4 req-c2325589-690e-4d5a-ab41-24d3548edbfd service nova] Creating event network-vif-deleted:8cb9cf89-cdd7-4d17-9a07-d6bba5ceb545 for instance ef32fe68-b121-4fdf-874b-db3e366da292 on hv-cinder-84067 May 23 15:44:11.496394 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [req-bc32ea6e-7ee1-468c-8204-15fca94309b4 req-c2325589-690e-4d5a-ab41-24d3548edbfd service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028906 May 23 15:44:11.497310 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 201/389] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:44:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:44:12.108282 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-87c3e728-d564-469b-9a81-bd7845d64136 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:44:12.108809 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-87c3e728-d564-469b-9a81-bd7845d64136 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:44:12.116162 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-87c3e728-d564-469b-9a81-bd7845d64136 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:12.116612 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-87c3e728-d564-469b-9a81-bd7845d64136 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:12.122807 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-87c3e728-d564-469b-9a81-bd7845d64136 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:12.122807 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-87c3e728-d564-469b-9a81-bd7845d64136 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:12.135417 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-6b5c6421-f5b9-46ee-9b38-e61a353d0f82 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:44:12.136119 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-6b5c6421-f5b9-46ee-9b38-e61a353d0f82 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 15c3a3b9-3d55-44c3-8627-ba397c1f069d] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:44:12.142202 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-6b5c6421-f5b9-46ee-9b38-e61a353d0f82 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:12.142658 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-6b5c6421-f5b9-46ee-9b38-e61a353d0f82 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:12.143431 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-6b5c6421-f5b9-46ee-9b38-e61a353d0f82 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:12.143871 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-6b5c6421-f5b9-46ee-9b38-e61a353d0f82 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:12.320118 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-87c3e728-d564-469b-9a81-bd7845d64136 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:44:12.329498 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-87c3e728-d564-469b-9a81-bd7845d64136 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 200 len: 1708 microversion: 2.1 time: 0.225025 May 23 15:44:12.330073 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 189/390] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:44:12 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 1708 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:44:12.332334 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-6b5c6421-f5b9-46ee-9b38-e61a353d0f82 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:44:12.340909 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-6b5c6421-f5b9-46ee-9b38-e61a353d0f82 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d" status: 200 len: 1371 microversion: 2.1 time: 0.209611 May 23 15:44:12.341512 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 202/391] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:44:12 2022] GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d => generated 1371 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:44:12.394033 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-aaa93cc9-0502-4835-b0ee-47d209070745 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:44:12.394933 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-aaa93cc9-0502-4835-b0ee-47d209070745 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] [instance: dd66096c-0b64-4a26-bdec-1b1a46310cfb] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:44:12.401089 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-aaa93cc9-0502-4835-b0ee-47d209070745 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:12.401578 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-aaa93cc9-0502-4835-b0ee-47d209070745 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:12.402356 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-aaa93cc9-0502-4835-b0ee-47d209070745 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:12.402801 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-aaa93cc9-0502-4835-b0ee-47d209070745 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:12.420430 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:44:12.451947 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-6d8ced96-9fb1-47c9-acd8-a83af41b0604 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:44:12.452545 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-6d8ced96-9fb1-47c9-acd8-a83af41b0604 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] [instance: ef32fe68-b121-4fdf-874b-db3e366da292] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:44:12.459456 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-6d8ced96-9fb1-47c9-acd8-a83af41b0604 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:12.459814 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-6d8ced96-9fb1-47c9-acd8-a83af41b0604 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:12.460587 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-6d8ced96-9fb1-47c9-acd8-a83af41b0604 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:12.461029 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-6d8ced96-9fb1-47c9-acd8-a83af41b0604 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:12.541737 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-6d8ced96-9fb1-47c9-acd8-a83af41b0604 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6badcf8b92dc43a3bc2342e303dec1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ef57ea448a49d3af268a02f6f08257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:44:12.550213 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-6d8ced96-9fb1-47c9-acd8-a83af41b0604 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] 10.222.0.64 "GET /compute/v2.1/servers/ef32fe68-b121-4fdf-874b-db3e366da292" status: 200 len: 1297 microversion: 2.1 time: 0.102134 May 23 15:44:12.552313 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 203/392] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:44:12 2022] GET /compute/v2.1/servers/ef32fe68-b121-4fdf-874b-db3e366da292 => generated 1297 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:44:12.568151 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-aaa93cc9-0502-4835-b0ee-47d209070745 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b983c0a2a124ac3aa3403e0777612f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0860b3d072246d49cd43a900351d571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:44:12.576589 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-aaa93cc9-0502-4835-b0ee-47d209070745 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] 10.222.0.64 "GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb" status: 200 len: 1259 microversion: 2.1 time: 0.186686 May 23 15:44:12.586211 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 190/393] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:44:12 2022] GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb => generated 1259 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:44:12.667771 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [req-a839fcd3-a1f5-4360-ac40-d61bace02ebc req-db73b3a9-7c2f-4c08-9e76-43d2cd797ce2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15c3a3b9-3d55-44c3-8627-ba397c1f069d", "name": "network-vif-plugged", "status": "completed", "tag": "f835d7e4-2023-42a3-91c1-27e29436c365"}]} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:44:12.681919 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-a839fcd3-a1f5-4360-ac40-d61bace02ebc req-db73b3a9-7c2f-4c08-9e76-43d2cd797ce2 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:12.682913 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-a839fcd3-a1f5-4360-ac40-d61bace02ebc req-db73b3a9-7c2f-4c08-9e76-43d2cd797ce2 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:12.697463 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.compute.server_external_events [req-a839fcd3-a1f5-4360-ac40-d61bace02ebc req-db73b3a9-7c2f-4c08-9e76-43d2cd797ce2 service nova] Creating event network-vif-plugged:f835d7e4-2023-42a3-91c1-27e29436c365 for instance 15c3a3b9-3d55-44c3-8627-ba397c1f069d on hv-cinder-84067 May 23 15:44:12.704130 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [req-a839fcd3-a1f5-4360-ac40-d61bace02ebc req-db73b3a9-7c2f-4c08-9e76-43d2cd797ce2 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040015 May 23 15:44:12.705040 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 204/394] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:44:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:44:13.346494 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-5de877d6-b59d-4148-b70b-cf5f8d1ce6dc tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:44:13.347278 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-5de877d6-b59d-4148-b70b-cf5f8d1ce6dc tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:44:13.354810 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-5de877d6-b59d-4148-b70b-cf5f8d1ce6dc tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:13.355348 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-5de877d6-b59d-4148-b70b-cf5f8d1ce6dc tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:13.356279 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-5de877d6-b59d-4148-b70b-cf5f8d1ce6dc tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:13.358635 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-5de877d6-b59d-4148-b70b-cf5f8d1ce6dc tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:13.358759 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-e191bed6-1ea2-4fd0-990c-61fda930b23d tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:44:13.359203 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-e191bed6-1ea2-4fd0-990c-61fda930b23d tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 15c3a3b9-3d55-44c3-8627-ba397c1f069d] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:44:13.365645 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e191bed6-1ea2-4fd0-990c-61fda930b23d tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:13.366106 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e191bed6-1ea2-4fd0-990c-61fda930b23d tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:13.366885 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e191bed6-1ea2-4fd0-990c-61fda930b23d tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:13.367322 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e191bed6-1ea2-4fd0-990c-61fda930b23d tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:13.567076 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-5de877d6-b59d-4148-b70b-cf5f8d1ce6dc tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:44:13.575559 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-5de877d6-b59d-4148-b70b-cf5f8d1ce6dc tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 200 len: 1708 microversion: 2.1 time: 0.232873 May 23 15:44:13.576133 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 191/395] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:44:13 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 1708 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:44:13.579096 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-e191bed6-1ea2-4fd0-990c-61fda930b23d tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:44:13.589928 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-b7b81610-e169-4b47-9157-04e380d5d971 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:44:13.595115 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-e191bed6-1ea2-4fd0-990c-61fda930b23d tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d" status: 200 len: 1371 microversion: 2.1 time: 0.235788 May 23 15:44:13.595261 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-b7b81610-e169-4b47-9157-04e380d5d971 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] [instance: ef32fe68-b121-4fdf-874b-db3e366da292] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:44:13.595400 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 205/396] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:44:13 2022] GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d => generated 1371 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:44:13.596243 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-80d5ac3a-e052-4130-ae31-d60692b40790 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:44:13.596951 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-80d5ac3a-e052-4130-ae31-d60692b40790 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] [instance: dd66096c-0b64-4a26-bdec-1b1a46310cfb] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:44:13.600735 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b7b81610-e169-4b47-9157-04e380d5d971 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:13.601253 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b7b81610-e169-4b47-9157-04e380d5d971 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:13.602598 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b7b81610-e169-4b47-9157-04e380d5d971 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:13.603320 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b7b81610-e169-4b47-9157-04e380d5d971 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:13.604274 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-80d5ac3a-e052-4130-ae31-d60692b40790 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:13.604840 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-80d5ac3a-e052-4130-ae31-d60692b40790 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:13.605872 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-80d5ac3a-e052-4130-ae31-d60692b40790 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:13.606406 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-80d5ac3a-e052-4130-ae31-d60692b40790 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:13.638105 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b7b81610-e169-4b47-9157-04e380d5d971 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:13.638671 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b7b81610-e169-4b47-9157-04e380d5d971 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:13.639193 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.objects.instance [None req-b7b81610-e169-4b47-9157-04e380d5d971 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lazy-loading 'fault' on Instance uuid ef32fe68-b121-4fdf-874b-db3e366da292 {{(pid=124933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 15:44:13.731777 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-b7b81610-e169-4b47-9157-04e380d5d971 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6badcf8b92dc43a3bc2342e303dec1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ef57ea448a49d3af268a02f6f08257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:44:13.741143 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-b7b81610-e169-4b47-9157-04e380d5d971 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] 10.222.0.64 "GET /compute/v2.1/servers/ef32fe68-b121-4fdf-874b-db3e366da292" status: 200 len: 1302 microversion: 2.1 time: 0.163622 May 23 15:44:13.742949 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 192/397] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:44:13 2022] GET /compute/v2.1/servers/ef32fe68-b121-4fdf-874b-db3e366da292 => generated 1302 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:44:13.807274 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-80d5ac3a-e052-4130-ae31-d60692b40790 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b983c0a2a124ac3aa3403e0777612f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0860b3d072246d49cd43a900351d571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:44:13.815113 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-80d5ac3a-e052-4130-ae31-d60692b40790 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] 10.222.0.64 "GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb" status: 200 len: 1443 microversion: 2.1 time: 0.223068 May 23 15:44:13.815817 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 206/398] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:44:13 2022] GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb => generated 1443 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:44:13.834468 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-a589698b-f078-4f53-b6ef-4ec81d03d117 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:44:13.838304 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-a589698b-f078-4f53-b6ef-4ec81d03d117 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] [instance: dd66096c-0b64-4a26-bdec-1b1a46310cfb] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:44:13.841119 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a589698b-f078-4f53-b6ef-4ec81d03d117 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:13.842961 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a589698b-f078-4f53-b6ef-4ec81d03d117 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:13.843730 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a589698b-f078-4f53-b6ef-4ec81d03d117 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:13.844167 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a589698b-f078-4f53-b6ef-4ec81d03d117 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:13.996670 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-a589698b-f078-4f53-b6ef-4ec81d03d117 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b983c0a2a124ac3aa3403e0777612f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0860b3d072246d49cd43a900351d571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:44:14.005009 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-a589698b-f078-4f53-b6ef-4ec81d03d117 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] 10.222.0.64 "GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb" status: 200 len: 1443 microversion: 2.1 time: 0.175155 May 23 15:44:14.005605 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 193/399] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:44:13 2022] GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb => generated 1443 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:44:14.602523 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-ba496cca-d3b0-4e08-8a2f-8f026488cf4b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:44:14.602523 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-ba496cca-d3b0-4e08-8a2f-8f026488cf4b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:44:14.606901 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ba496cca-d3b0-4e08-8a2f-8f026488cf4b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:14.607367 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ba496cca-d3b0-4e08-8a2f-8f026488cf4b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:14.608415 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ba496cca-d3b0-4e08-8a2f-8f026488cf4b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:14.608617 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ba496cca-d3b0-4e08-8a2f-8f026488cf4b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:14.622366 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-c0cfc8df-6c55-4063-9f36-848d38879a79 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:44:14.624100 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-c0cfc8df-6c55-4063-9f36-848d38879a79 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 15c3a3b9-3d55-44c3-8627-ba397c1f069d] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:44:14.634034 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c0cfc8df-6c55-4063-9f36-848d38879a79 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:14.635185 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c0cfc8df-6c55-4063-9f36-848d38879a79 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:14.636076 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c0cfc8df-6c55-4063-9f36-848d38879a79 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:14.637104 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c0cfc8df-6c55-4063-9f36-848d38879a79 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:14.902039 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-ba496cca-d3b0-4e08-8a2f-8f026488cf4b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:44:14.921660 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-ba496cca-d3b0-4e08-8a2f-8f026488cf4b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 200 len: 1712 microversion: 2.1 time: 0.326990 May 23 15:44:14.925199 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 207/400] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:44:14 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 1712 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:44:14.928559 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-c0cfc8df-6c55-4063-9f36-848d38879a79 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:44:14.929186 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-6a919058-a2e3-4511-90de-add47fd37912 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:44:14.929792 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-6a919058-a2e3-4511-90de-add47fd37912 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] [instance: ef32fe68-b121-4fdf-874b-db3e366da292] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:44:14.936276 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-6a919058-a2e3-4511-90de-add47fd37912 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:14.936801 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-6a919058-a2e3-4511-90de-add47fd37912 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:14.937617 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-c0cfc8df-6c55-4063-9f36-848d38879a79 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d" status: 200 len: 1371 microversion: 2.1 time: 0.320208 May 23 15:44:14.937735 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-6a919058-a2e3-4511-90de-add47fd37912 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:14.938063 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-6a919058-a2e3-4511-90de-add47fd37912 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:14.945968 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 194/401] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:44:14 2022] GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d => generated 1371 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:44:14.959515 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:44:14.973616 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-6a919058-a2e3-4511-90de-add47fd37912 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:14.974101 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-6a919058-a2e3-4511-90de-add47fd37912 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:14.974564 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.objects.instance [None req-6a919058-a2e3-4511-90de-add47fd37912 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lazy-loading 'fault' on Instance uuid ef32fe68-b121-4fdf-874b-db3e366da292 {{(pid=124934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 15:44:15.017002 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-6a919058-a2e3-4511-90de-add47fd37912 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6badcf8b92dc43a3bc2342e303dec1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ef57ea448a49d3af268a02f6f08257', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:44:15.026191 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-6a919058-a2e3-4511-90de-add47fd37912 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] 10.222.0.64 "GET /compute/v2.1/servers/ef32fe68-b121-4fdf-874b-db3e366da292" status: 200 len: 1302 microversion: 2.1 time: 0.102303 May 23 15:44:15.026979 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 208/402] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:44:14 2022] GET /compute/v2.1/servers/ef32fe68-b121-4fdf-874b-db3e366da292 => generated 1302 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:44:15.957451 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-4a8c2e55-36d8-4b7f-9a20-a24db8da8e94 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:44:15.958244 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-4a8c2e55-36d8-4b7f-9a20-a24db8da8e94 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 15c3a3b9-3d55-44c3-8627-ba397c1f069d] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:44:15.964715 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-4a8c2e55-36d8-4b7f-9a20-a24db8da8e94 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:15.965272 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-4a8c2e55-36d8-4b7f-9a20-a24db8da8e94 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:15.966146 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-4a8c2e55-36d8-4b7f-9a20-a24db8da8e94 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:15.966688 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-4a8c2e55-36d8-4b7f-9a20-a24db8da8e94 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:16.043561 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-2cf37fec-c5e5-41c5-a0ee-24f25bfb9e63 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:44:16.044170 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-2cf37fec-c5e5-41c5-a0ee-24f25bfb9e63 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] [instance: ef32fe68-b121-4fdf-874b-db3e366da292] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:44:16.051892 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2cf37fec-c5e5-41c5-a0ee-24f25bfb9e63 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:16.055146 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2cf37fec-c5e5-41c5-a0ee-24f25bfb9e63 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:16.056034 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2cf37fec-c5e5-41c5-a0ee-24f25bfb9e63 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:16.056489 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2cf37fec-c5e5-41c5-a0ee-24f25bfb9e63 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:16.071511 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.wsgi [None req-2cf37fec-c5e5-41c5-a0ee-24f25bfb9e63 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] HTTP exception thrown: Instance ef32fe68-b121-4fdf-874b-db3e366da292 could not be found. May 23 15:44:16.073853 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-2cf37fec-c5e5-41c5-a0ee-24f25bfb9e63 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Request method failure captured: May 23 15:44:16.073853 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: request: GET /compute/v2.1/servers/ef32fe68-b121-4fdf-874b-db3e366da292 HTTP/1.1 May 23 15:44:16.073853 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Accept: application/json May 23 15:44:16.073853 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Accept-Encoding: identity May 23 15:44:16.073853 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Connection: close May 23 15:44:16.073853 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Content-Length: 0 May 23 15:44:16.073853 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Content-Type: application/json May 23 15:44:16.073853 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Host: 10.222.0.64 May 23 15:44:16.073853 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Openstack-System-Scope: None May 23 15:44:16.073853 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: User-Agent: python-urllib3/1.26.9 May 23 15:44:16.073853 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Auth-Token: gAAAAABii6uDsutXsIwiNt9SPQqqH1l82E8ePlgUe0Qkm9sMiKd-vuz-StQSVSZndc2fusuMjXt62MEW5Pv0PU3h2-dAc5_3VbnfHMKn2GVD_Ju47SnE7GArntQHKSGiubSoNIjIAmLDRbh8BjhT_0oDvCfA69PFaUQIdBY9n-saIXQwjhUILGo May 23 15:44:16.073853 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Domain-Id: None May 23 15:44:16.073853 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Domain-Name: None May 23 15:44:16.073853 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Identity-Status: Confirmed May 23 15:44:16.073853 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Is-Admin-Project: True May 23 15:44:16.073853 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Domain-Id: default May 23 15:44:16.073853 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Domain-Name: Default May 23 15:44:16.073853 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Id: c2ef57ea448a49d3af268a02f6f08257 May 23 15:44:16.073853 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Name: tempest-VolumesActionsTest-2033716942 May 23 15:44:16.073853 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Role: reader,member May 23 15:44:16.073853 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Roles: reader,member May 23 15:44:16.075271 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/c2ef57ea448a49d3af268a02f6f08257"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/c2ef57ea448a49d3af268a02f6f08257"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/c2ef57ea448a49d3af268a02f6f08257"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_c2ef57ea448a49d3af268a02f6f08257", "adminURL": "http://10.222.0.64:8080"}]}] May 23 15:44:16.075271 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant: tempest-VolumesActionsTest-2033716942 May 23 15:44:16.075271 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant-Id: c2ef57ea448a49d3af268a02f6f08257 May 23 15:44:16.075271 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant-Name: tempest-VolumesActionsTest-2033716942 May 23 15:44:16.075271 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User: tempest-VolumesActionsTest-2033716942-project May 23 15:44:16.075271 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Domain-Id: default May 23 15:44:16.075271 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Domain-Name: Default May 23 15:44:16.075271 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Id: 6badcf8b92dc43a3bc2342e303dec1da May 23 15:44:16.075271 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Name: tempest-VolumesActionsTest-2033716942-project May 23 15:44:16.075271 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: method: > May 23 15:44:16.075271 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: exception: Instance ef32fe68-b121-4fdf-874b-db3e366da292 could not be found. May 23 15:44:16.075271 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: action_args: {'id': 'ef32fe68-b121-4fdf-874b-db3e366da292'} May 23 15:44:16.076864 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:44:16.076864 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:44:16.076864 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:44:16.076864 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:44:16.076864 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:44:16.076864 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:44:16.076864 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:44:16.076864 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:44:16.076864 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:44:16.076864 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:44:16.076864 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef32fe68-b121-4fdf-874b-db3e366da292 could not be found. May 23 15:44:16.076864 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:44:16.076864 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:44:16.076864 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:44:16.076864 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:44:16.076864 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:44:16.076864 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:44:16.076864 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:44:16.076864 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:44:16.076864 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:44:16.083887 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:44:16.083887 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 15:44:16.083887 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 15:44:16.083887 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:44:16.083887 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:44:16.083887 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:44:16.083887 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:44:16.083887 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef32fe68-b121-4fdf-874b-db3e366da292 could not be found. May 23 15:44:16.083887 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:44:16.083887 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:44:16.083887 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:44:16.083887 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:44:16.083887 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:44:16.083887 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:44:16.083887 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:44:16.083887 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:44:16.083887 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef32fe68-b121-4fdf-874b-db3e366da292 could not be found. May 23 15:44:16.083887 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:44:16.085640 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-2cf37fec-c5e5-41c5-a0ee-24f25bfb9e63 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] Returning 404 to user: Instance ef32fe68-b121-4fdf-874b-db3e366da292 could not be found. {{(pid=124934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:44:16.085640 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-2cf37fec-c5e5-41c5-a0ee-24f25bfb9e63 tempest-VolumesActionsTest-2033716942 tempest-VolumesActionsTest-2033716942-project] 10.222.0.64 "GET /compute/v2.1/servers/ef32fe68-b121-4fdf-874b-db3e366da292" status: 404 len: 111 microversion: 2.1 time: 0.035339 May 23 15:44:16.085640 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 209/403] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:44:16 2022] GET /compute/v2.1/servers/ef32fe68-b121-4fdf-874b-db3e366da292 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 23 15:44:16.413382 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-4a8c2e55-36d8-4b7f-9a20-a24db8da8e94 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:44:16.426832 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-4a8c2e55-36d8-4b7f-9a20-a24db8da8e94 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d" status: 200 len: 1371 microversion: 2.1 time: 0.470632 May 23 15:44:16.426832 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 195/404] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:44:15 2022] GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d => generated 1371 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:44:16.780205 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [req-3498db4c-b167-49f1-9af0-8a1fe031aded req-749af3d3-852f-49b0-bfad-6d60b8be9430 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd66096c-0b64-4a26-bdec-1b1a46310cfb", "tag": "a0610243-2466-4315-a3e6-15f6cea816b8"}]} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:44:16.789725 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-3498db4c-b167-49f1-9af0-8a1fe031aded req-749af3d3-852f-49b0-bfad-6d60b8be9430 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:16.790428 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-3498db4c-b167-49f1-9af0-8a1fe031aded req-749af3d3-852f-49b0-bfad-6d60b8be9430 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:16.814354 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.compute.server_external_events [req-3498db4c-b167-49f1-9af0-8a1fe031aded req-749af3d3-852f-49b0-bfad-6d60b8be9430 service nova] Creating event network-changed:a0610243-2466-4315-a3e6-15f6cea816b8 for instance dd66096c-0b64-4a26-bdec-1b1a46310cfb on hv-cinder-84067 May 23 15:44:16.814354 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [req-3498db4c-b167-49f1-9af0-8a1fe031aded req-749af3d3-852f-49b0-bfad-6d60b8be9430 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032892 May 23 15:44:16.814354 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 210/405] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:44:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:44:17.441987 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-07bfb55e-5bd2-468d-82a4-954d0547a838 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:44:17.444163 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-07bfb55e-5bd2-468d-82a4-954d0547a838 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 15c3a3b9-3d55-44c3-8627-ba397c1f069d] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:44:17.450553 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-07bfb55e-5bd2-468d-82a4-954d0547a838 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:17.451120 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-07bfb55e-5bd2-468d-82a4-954d0547a838 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:17.452194 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-07bfb55e-5bd2-468d-82a4-954d0547a838 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:17.452694 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-07bfb55e-5bd2-468d-82a4-954d0547a838 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:17.652614 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-07bfb55e-5bd2-468d-82a4-954d0547a838 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:44:17.662984 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-07bfb55e-5bd2-468d-82a4-954d0547a838 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d" status: 200 len: 1562 microversion: 2.1 time: 0.226305 May 23 15:44:17.663792 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 196/406] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:44:17 2022] GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d => generated 1562 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:44:17.682486 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-3dbff22d-b978-4c0c-af25-fb0c38f955cc tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:44:17.683070 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-3dbff22d-b978-4c0c-af25-fb0c38f955cc tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 15c3a3b9-3d55-44c3-8627-ba397c1f069d] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:44:17.690171 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3dbff22d-b978-4c0c-af25-fb0c38f955cc tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:17.690624 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3dbff22d-b978-4c0c-af25-fb0c38f955cc tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:17.691992 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3dbff22d-b978-4c0c-af25-fb0c38f955cc tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:17.692431 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3dbff22d-b978-4c0c-af25-fb0c38f955cc tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:17.805961 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-3dbff22d-b978-4c0c-af25-fb0c38f955cc tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.127787 May 23 15:44:17.806547 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 211/407] 10.222.0.64 () {58 vars in 1274 bytes} [Mon May 23 15:44:17 2022] GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d/os-interface => generated 284 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:44:19.120237 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [req-6c2147b0-32b5-4f5d-9edb-68cebdfe971e req-dee871d9-98f1-4e65-a7a9-3245935e4889 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15c3a3b9-3d55-44c3-8627-ba397c1f069d", "tag": "f835d7e4-2023-42a3-91c1-27e29436c365"}]} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:44:19.129962 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-6c2147b0-32b5-4f5d-9edb-68cebdfe971e req-dee871d9-98f1-4e65-a7a9-3245935e4889 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:19.130411 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-6c2147b0-32b5-4f5d-9edb-68cebdfe971e req-dee871d9-98f1-4e65-a7a9-3245935e4889 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:19.141514 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.compute.server_external_events [req-6c2147b0-32b5-4f5d-9edb-68cebdfe971e req-dee871d9-98f1-4e65-a7a9-3245935e4889 service nova] Creating event network-changed:f835d7e4-2023-42a3-91c1-27e29436c365 for instance 15c3a3b9-3d55-44c3-8627-ba397c1f069d on hv-cinder-84067 May 23 15:44:19.147444 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [req-6c2147b0-32b5-4f5d-9edb-68cebdfe971e req-dee871d9-98f1-4e65-a7a9-3245935e4889 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030943 May 23 15:44:19.148453 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 197/408] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:44:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:44:41.658896 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_api:SELECT=65 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:44:41.659930 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_cell1:SELECT=12 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:44:41.663675 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-bf44ff5a-2f14-4948-b7f7-c5faa5b1b01d tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:44:41.667614 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-bf44ff5a-2f14-4948-b7f7-c5faa5b1b01d tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: ce2cd056-b2f1-43fb-a60a-323039d15162] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:44:41.673897 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-bf44ff5a-2f14-4948-b7f7-c5faa5b1b01d tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:41.674517 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-bf44ff5a-2f14-4948-b7f7-c5faa5b1b01d tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:41.675310 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-bf44ff5a-2f14-4948-b7f7-c5faa5b1b01d tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:41.675880 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-bf44ff5a-2f14-4948-b7f7-c5faa5b1b01d tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:41.706969 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-bf44ff5a-2f14-4948-b7f7-c5faa5b1b01d tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162/ips" status: 200 len: 149 microversion: 2.1 time: 0.049097 May 23 15:44:41.707548 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 212/409] 10.222.0.64 () {58 vars in 1247 bytes} [Mon May 23 15:44:41 2022] GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162/ips => generated 149 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:44:43.456774 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-0115de04-be3f-4791-831b-f47080b3d238 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8f0ad502-a7fc-4cd6-803d-e41ae63f7048"}} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:44:43.458973 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-0115de04-be3f-4791-831b-f47080b3d238 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: ce2cd056-b2f1-43fb-a60a-323039d15162] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:44:43.461900 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:44:43.462832 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_cell1:SELECT=42 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:44:43.470147 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-0115de04-be3f-4791-831b-f47080b3d238 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:43.475154 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-0115de04-be3f-4791-831b-f47080b3d238 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:43.475154 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-0115de04-be3f-4791-831b-f47080b3d238 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:44:43.475154 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-0115de04-be3f-4791-831b-f47080b3d238 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:44:44.255181 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-0115de04-be3f-4791-831b-f47080b3d238 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "POST /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.805397 May 23 15:44:44.256220 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 198/410] 10.222.0.64 () {60 vars in 1322 bytes} [Mon May 23 15:44:43 2022] POST /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162/os-volume_attachments => generated 194 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:45:00.205376 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-fb722f0d-5fe8-4f97-acf5-8e7f02888504 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Action: 'create', calling method: .version_select at 0x7fab53334ca0>, body: {"keypair": {"name": "tempest-keypair-565907814", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJs+TP5dxQHFgQ29wMP0Qf0/Gr0NGE7DjOTbCmBAIS3/ghxALean8OKADf1Sv8SbQZz0Pqlj+XLgP7XJRwXSGeAwX6H50G2e90kZlIgIrUGuYwRj+nVJiBmO8XlCcoMBww=="}} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:45:00.211075 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_api:SELECT=2 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:00.220881 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.quota [None req-fb722f0d-5fe8-4f97-acf5-8e7f02888504 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Getting quotas for project a15ae9d15a64468f80628ed51c2e42d6. Resources: {'key_pairs'} {{(pid=124934) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 15:45:00.227260 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.quota [None req-fb722f0d-5fe8-4f97-acf5-8e7f02888504 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Getting quotas for user 472049224bbf48699b8a9410ec61aa9e and project a15ae9d15a64468f80628ed51c2e42d6. Resources: {'key_pairs'} {{(pid=124934) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 15:45:00.302525 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-fb722f0d-5fe8-4f97-acf5-8e7f02888504 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.102010 May 23 15:45:00.303813 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 213/411] 10.222.0.64 () {60 vars in 1158 bytes} [Mon May 23 15:45:00 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:45:02.726049 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_api:SELECT=2 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:02.727524 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:02.732339 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-3985b329-46a2-45dc-88f1-06803a178458 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-452329179", "imageRef": "a5c8503f-3733-426f-8a5b-c7c9358e4a45", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6b67b25e-d689-4151-bafc-c9d67faaca84"}], "security_groups": [{"name": "tempest-securitygroup--1310211778"}], "key_name": "tempest-keypair-565907814", "user_data": "}} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:45:02.849298 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.network.neutron [None req-3985b329-46a2-45dc-88f1-06803a178458 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] validate_networks() for [('6b67b25e-d689-4151-bafc-c9d67faaca84', None, None, None, None, None)] {{(pid=124933) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 15:45:03.227779 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.virt.hardware [None req-3985b329-46a2-45dc-88f1-06803a178458 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Flavor limits 0:0:0 {{(pid=124933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 15:45:03.228791 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.virt.hardware [None req-3985b329-46a2-45dc-88f1-06803a178458 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Image limits 0:0:0 {{(pid=124933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 15:45:03.228791 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.virt.hardware [None req-3985b329-46a2-45dc-88f1-06803a178458 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Flavor pref 0:0:0 {{(pid=124933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 15:45:03.229309 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.virt.hardware [None req-3985b329-46a2-45dc-88f1-06803a178458 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Image pref 0:0:0 {{(pid=124933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 15:45:03.229788 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.virt.hardware [None req-3985b329-46a2-45dc-88f1-06803a178458 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 15:45:03.239525 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-3985b329-46a2-45dc-88f1-06803a178458 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:03.240014 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-3985b329-46a2-45dc-88f1-06803a178458 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:03.241617 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-3985b329-46a2-45dc-88f1-06803a178458 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:03.242039 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-3985b329-46a2-45dc-88f1-06803a178458 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:03.259213 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.quota [None req-3985b329-46a2-45dc-88f1-06803a178458 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Getting quotas for project a15ae9d15a64468f80628ed51c2e42d6. Resources: {'ram', 'instances', 'cores'} {{(pid=124933) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 15:45:03.263226 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.quota [None req-3985b329-46a2-45dc-88f1-06803a178458 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Getting quotas for user 472049224bbf48699b8a9410ec61aa9e and project a15ae9d15a64468f80628ed51c2e42d6. Resources: {'ram', 'instances', 'cores'} {{(pid=124933) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 15:45:03.275190 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-3985b329-46a2-45dc-88f1-06803a178458 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Going to run 1 instances... {{(pid=124933) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 15:45:03.277585 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-3985b329-46a2-45dc-88f1-06803a178458 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: aafabce5-30ac-488a-9d85-2d453337bf71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5c8503f-3733-426f-8a5b-c7c9358e4a45',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124933) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 15:45:03.393872 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-3985b329-46a2-45dc-88f1-06803a178458 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.669750 May 23 15:45:03.394601 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 199/412] 10.222.0.64 () {60 vars in 1146 bytes} [Mon May 23 15:45:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 15:45:03.405554 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-a827fdd4-b88b-4f40-97b2-96db8dcac3a0 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:03.406022 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-a827fdd4-b88b-4f40-97b2-96db8dcac3a0 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: aafabce5-30ac-488a-9d85-2d453337bf71] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:03.496258 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-a827fdd4-b88b-4f40-97b2-96db8dcac3a0 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:03.502988 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-a827fdd4-b88b-4f40-97b2-96db8dcac3a0 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/aafabce5-30ac-488a-9d85-2d453337bf71" status: 200 len: 1240 microversion: 2.1 time: 0.101308 May 23 15:45:03.503691 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 214/413] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:03 2022] GET /compute/v2.1/servers/aafabce5-30ac-488a-9d85-2d453337bf71 => generated 1240 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:45:04.521788 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-f3589931-24db-4275-aca3-3e476d716085 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:04.528587 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-f3589931-24db-4275-aca3-3e476d716085 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: aafabce5-30ac-488a-9d85-2d453337bf71] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:04.532424 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-f3589931-24db-4275-aca3-3e476d716085 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:04.533002 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-f3589931-24db-4275-aca3-3e476d716085 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:04.533988 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-f3589931-24db-4275-aca3-3e476d716085 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:04.534506 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-f3589931-24db-4275-aca3-3e476d716085 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:04.638441 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-f3589931-24db-4275-aca3-3e476d716085 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:04.646145 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-f3589931-24db-4275-aca3-3e476d716085 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/aafabce5-30ac-488a-9d85-2d453337bf71" status: 200 len: 1244 microversion: 2.1 time: 0.129847 May 23 15:45:04.646762 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 200/414] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:04 2022] GET /compute/v2.1/servers/aafabce5-30ac-488a-9d85-2d453337bf71 => generated 1244 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:45:05.665269 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-2d5298fe-fdd5-42e7-a9f2-c3dd5c323e6a tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:05.666972 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-2d5298fe-fdd5-42e7-a9f2-c3dd5c323e6a tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: aafabce5-30ac-488a-9d85-2d453337bf71] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:05.687708 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2d5298fe-fdd5-42e7-a9f2-c3dd5c323e6a tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:05.688172 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2d5298fe-fdd5-42e7-a9f2-c3dd5c323e6a tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:05.688961 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2d5298fe-fdd5-42e7-a9f2-c3dd5c323e6a tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:05.689432 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2d5298fe-fdd5-42e7-a9f2-c3dd5c323e6a tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:05.901040 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-2d5298fe-fdd5-42e7-a9f2-c3dd5c323e6a tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:05.914264 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-2d5298fe-fdd5-42e7-a9f2-c3dd5c323e6a tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/aafabce5-30ac-488a-9d85-2d453337bf71" status: 200 len: 1292 microversion: 2.1 time: 0.254435 May 23 15:45:05.916487 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 215/415] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:05 2022] GET /compute/v2.1/servers/aafabce5-30ac-488a-9d85-2d453337bf71 => generated 1292 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:45:06.535563 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-a63ad930-931a-456f-8198-66dc54cef01a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:06.536140 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-a63ad930-931a-456f-8198-66dc54cef01a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:06.547750 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a63ad930-931a-456f-8198-66dc54cef01a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:06.548468 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a63ad930-931a-456f-8198-66dc54cef01a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:06.549675 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a63ad930-931a-456f-8198-66dc54cef01a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:06.550342 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a63ad930-931a-456f-8198-66dc54cef01a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:06.704947 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.objects.instance [None req-a63ad930-931a-456f-8198-66dc54cef01a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lazy-loading 'services' on Instance uuid 800dd67c-e6dd-4712-9fe6-8d823b845358 {{(pid=124933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 15:45:06.934111 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-f66a2183-ae91-404e-842d-2476d343e00e tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:06.935384 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-f66a2183-ae91-404e-842d-2476d343e00e tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: aafabce5-30ac-488a-9d85-2d453337bf71] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:06.942372 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-f66a2183-ae91-404e-842d-2476d343e00e tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:06.943125 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-f66a2183-ae91-404e-842d-2476d343e00e tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:06.945500 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-f66a2183-ae91-404e-842d-2476d343e00e tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:06.946137 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-f66a2183-ae91-404e-842d-2476d343e00e tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:07.015278 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-a63ad930-931a-456f-8198-66dc54cef01a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "DELETE /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358/os-volume_attachments/17620297-ecaa-4407-9cc4-87cfaeefc822" status: 202 len: 0 microversion: 2.1 time: 0.484679 May 23 15:45:07.021580 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-f66a2183-ae91-404e-842d-2476d343e00e tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:07.033591 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 201/416] 10.222.0.64 () {58 vars in 1415 bytes} [Mon May 23 15:45:06 2022] DELETE /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358/os-volume_attachments/17620297-ecaa-4407-9cc4-87cfaeefc822 => generated 0 bytes in 503 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 15:45:07.045195 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-f66a2183-ae91-404e-842d-2476d343e00e tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/aafabce5-30ac-488a-9d85-2d453337bf71" status: 200 len: 1298 microversion: 2.1 time: 0.114643 May 23 15:45:07.045863 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 216/417] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:06 2022] GET /compute/v2.1/servers/aafabce5-30ac-488a-9d85-2d453337bf71 => generated 1298 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:45:08.070177 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-e522a3b5-e479-4a72-a9a3-90e7f2d16131 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:08.070870 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-e522a3b5-e479-4a72-a9a3-90e7f2d16131 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: aafabce5-30ac-488a-9d85-2d453337bf71] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:08.083138 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e522a3b5-e479-4a72-a9a3-90e7f2d16131 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:08.083720 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e522a3b5-e479-4a72-a9a3-90e7f2d16131 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:08.085539 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e522a3b5-e479-4a72-a9a3-90e7f2d16131 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:08.085958 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e522a3b5-e479-4a72-a9a3-90e7f2d16131 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:08.271151 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-e522a3b5-e479-4a72-a9a3-90e7f2d16131 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:08.279390 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-e522a3b5-e479-4a72-a9a3-90e7f2d16131 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/aafabce5-30ac-488a-9d85-2d453337bf71" status: 200 len: 1366 microversion: 2.1 time: 0.216596 May 23 15:45:08.279963 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 202/418] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:08 2022] GET /compute/v2.1/servers/aafabce5-30ac-488a-9d85-2d453337bf71 => generated 1366 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:45:09.296182 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-3e354a5e-3306-4307-b489-c58296ceca5c tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:09.297842 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-3e354a5e-3306-4307-b489-c58296ceca5c tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: aafabce5-30ac-488a-9d85-2d453337bf71] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:09.303883 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3e354a5e-3306-4307-b489-c58296ceca5c tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:09.304340 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3e354a5e-3306-4307-b489-c58296ceca5c tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:09.305173 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3e354a5e-3306-4307-b489-c58296ceca5c tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:09.305618 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3e354a5e-3306-4307-b489-c58296ceca5c tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:09.454220 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-3e354a5e-3306-4307-b489-c58296ceca5c tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:09.462345 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-3e354a5e-3306-4307-b489-c58296ceca5c tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/aafabce5-30ac-488a-9d85-2d453337bf71" status: 200 len: 1366 microversion: 2.1 time: 0.170060 May 23 15:45:09.462907 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 217/419] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:09 2022] GET /compute/v2.1/servers/aafabce5-30ac-488a-9d85-2d453337bf71 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:45:10.480757 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-15118929-5d20-470d-95f5-02a6e939d368 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:10.482352 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-15118929-5d20-470d-95f5-02a6e939d368 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: aafabce5-30ac-488a-9d85-2d453337bf71] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:10.489129 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-15118929-5d20-470d-95f5-02a6e939d368 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:10.489855 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-15118929-5d20-470d-95f5-02a6e939d368 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:10.491412 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-15118929-5d20-470d-95f5-02a6e939d368 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:10.492082 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-15118929-5d20-470d-95f5-02a6e939d368 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:10.626898 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-15118929-5d20-470d-95f5-02a6e939d368 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:10.635850 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-15118929-5d20-470d-95f5-02a6e939d368 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/aafabce5-30ac-488a-9d85-2d453337bf71" status: 200 len: 1366 microversion: 2.1 time: 0.159362 May 23 15:45:10.637688 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 203/420] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:10 2022] GET /compute/v2.1/servers/aafabce5-30ac-488a-9d85-2d453337bf71 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:45:11.653749 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-5ede0735-daa6-4514-a17a-82a3c89a6882 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:11.654467 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-5ede0735-daa6-4514-a17a-82a3c89a6882 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: aafabce5-30ac-488a-9d85-2d453337bf71] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:11.668073 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5ede0735-daa6-4514-a17a-82a3c89a6882 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:11.668793 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5ede0735-daa6-4514-a17a-82a3c89a6882 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:11.670069 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5ede0735-daa6-4514-a17a-82a3c89a6882 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:11.670953 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5ede0735-daa6-4514-a17a-82a3c89a6882 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:11.906657 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-5ede0735-daa6-4514-a17a-82a3c89a6882 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:11.930225 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-5ede0735-daa6-4514-a17a-82a3c89a6882 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/aafabce5-30ac-488a-9d85-2d453337bf71" status: 200 len: 1366 microversion: 2.1 time: 0.280788 May 23 15:45:11.933288 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 218/421] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:11 2022] GET /compute/v2.1/servers/aafabce5-30ac-488a-9d85-2d453337bf71 => generated 1366 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:45:12.950203 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-3eaaaba3-277f-46b3-a8e6-4955bb9e05e7 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:12.951416 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-3eaaaba3-277f-46b3-a8e6-4955bb9e05e7 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: aafabce5-30ac-488a-9d85-2d453337bf71] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:12.960847 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-3eaaaba3-277f-46b3-a8e6-4955bb9e05e7 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:12.961703 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-3eaaaba3-277f-46b3-a8e6-4955bb9e05e7 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:12.963544 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-3eaaaba3-277f-46b3-a8e6-4955bb9e05e7 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:12.967451 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-3eaaaba3-277f-46b3-a8e6-4955bb9e05e7 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:13.135871 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-3eaaaba3-277f-46b3-a8e6-4955bb9e05e7 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:13.149539 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-3eaaaba3-277f-46b3-a8e6-4955bb9e05e7 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/aafabce5-30ac-488a-9d85-2d453337bf71" status: 200 len: 1366 microversion: 2.1 time: 0.202836 May 23 15:45:13.161188 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 204/422] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:12 2022] GET /compute/v2.1/servers/aafabce5-30ac-488a-9d85-2d453337bf71 => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:45:14.168674 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-a6eea5e5-4217-4505-a9e4-4280fa573f6b tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:14.170190 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-a6eea5e5-4217-4505-a9e4-4280fa573f6b tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: aafabce5-30ac-488a-9d85-2d453337bf71] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:14.174161 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_cell0:SELECT=6 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:14.179214 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-a6eea5e5-4217-4505-a9e4-4280fa573f6b tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:14.179676 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-a6eea5e5-4217-4505-a9e4-4280fa573f6b tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:14.180581 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-a6eea5e5-4217-4505-a9e4-4280fa573f6b tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:14.181031 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-a6eea5e5-4217-4505-a9e4-4280fa573f6b tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:14.336384 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-a6eea5e5-4217-4505-a9e4-4280fa573f6b tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:14.347252 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-a6eea5e5-4217-4505-a9e4-4280fa573f6b tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/aafabce5-30ac-488a-9d85-2d453337bf71" status: 200 len: 1366 microversion: 2.1 time: 0.182966 May 23 15:45:14.347939 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 219/423] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:14 2022] GET /compute/v2.1/servers/aafabce5-30ac-488a-9d85-2d453337bf71 => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:45:14.372152 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-ee06cbfa-fd82-4679-bbce-12b7e577b87e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7f22b416-6cbb-4e72-b5f9-e986120e2381"}} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:45:14.373883 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-ee06cbfa-fd82-4679-bbce-12b7e577b87e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 15c3a3b9-3d55-44c3-8627-ba397c1f069d] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:14.376853 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_cell0:SELECT=2 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:14.377822 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_cell0:SELECT=6 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:14.382711 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ee06cbfa-fd82-4679-bbce-12b7e577b87e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:14.383385 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ee06cbfa-fd82-4679-bbce-12b7e577b87e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:14.384393 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ee06cbfa-fd82-4679-bbce-12b7e577b87e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:14.384830 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ee06cbfa-fd82-4679-bbce-12b7e577b87e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:15.449201 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-06862598-dc51-487b-80ff-9119fbbb6889 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Action: 'create', calling method: .version_select at 0x7fab520b9550>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1689259836", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK0/eQjI/gEVEjv2yzNMIwGg4+8mFUoKRQfW0li64vaMSz2qxUzZHAiJqa/LA1dCJORwYFQHM3Lyab3szsA5gxzrzWBw4Zen1uq8Rwlf7ZHbADviNaBzc0M5OWbss/cRiw=="}} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:45:15.466835 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.quota [None req-06862598-dc51-487b-80ff-9119fbbb6889 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Getting quotas for project 6263581d20ea47bcae22d736f7934e05. Resources: {'key_pairs'} {{(pid=124934) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 15:45:15.473039 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.quota [None req-06862598-dc51-487b-80ff-9119fbbb6889 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Getting quotas for user ba0229c6732541b4a6dda9040c038686 and project 6263581d20ea47bcae22d736f7934e05. Resources: {'key_pairs'} {{(pid=124934) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 15:45:15.652827 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-06862598-dc51-487b-80ff-9119fbbb6889 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.436835 May 23 15:45:15.656478 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 220/424] 10.222.0.64 () {60 vars in 1158 bytes} [Mon May 23 15:45:15 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:45:15.663158 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-4e1fbff0-92bb-4718-a637-90abcd26602f tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:15.663991 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-4e1fbff0-92bb-4718-a637-90abcd26602f tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: aafabce5-30ac-488a-9d85-2d453337bf71] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:15.673407 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4e1fbff0-92bb-4718-a637-90abcd26602f tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:15.674069 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4e1fbff0-92bb-4718-a637-90abcd26602f tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:15.675070 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4e1fbff0-92bb-4718-a637-90abcd26602f tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:15.675506 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4e1fbff0-92bb-4718-a637-90abcd26602f tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:15.820619 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-4e1fbff0-92bb-4718-a637-90abcd26602f tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:15.829255 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-4e1fbff0-92bb-4718-a637-90abcd26602f tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/aafabce5-30ac-488a-9d85-2d453337bf71" status: 200 len: 1366 microversion: 2.1 time: 0.171369 May 23 15:45:15.830117 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 221/425] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:15 2022] GET /compute/v2.1/servers/aafabce5-30ac-488a-9d85-2d453337bf71 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:45:16.846677 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-80f718f7-1ca2-4aa4-806c-7b419d338a5b tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:16.847344 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-80f718f7-1ca2-4aa4-806c-7b419d338a5b tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: aafabce5-30ac-488a-9d85-2d453337bf71] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:16.854014 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-80f718f7-1ca2-4aa4-806c-7b419d338a5b tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:16.854465 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-80f718f7-1ca2-4aa4-806c-7b419d338a5b tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:16.855225 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-80f718f7-1ca2-4aa4-806c-7b419d338a5b tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:16.855657 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-80f718f7-1ca2-4aa4-806c-7b419d338a5b tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:17.030593 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-80f718f7-1ca2-4aa4-806c-7b419d338a5b tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:17.043185 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-80f718f7-1ca2-4aa4-806c-7b419d338a5b tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/aafabce5-30ac-488a-9d85-2d453337bf71" status: 200 len: 1366 microversion: 2.1 time: 0.199781 May 23 15:45:17.045265 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 222/426] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:16 2022] GET /compute/v2.1/servers/aafabce5-30ac-488a-9d85-2d453337bf71 => generated 1366 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:45:18.060690 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-e0644253-6577-432b-a809-43d7a8b16820 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:18.062004 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-e0644253-6577-432b-a809-43d7a8b16820 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: aafabce5-30ac-488a-9d85-2d453337bf71] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:18.068383 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e0644253-6577-432b-a809-43d7a8b16820 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:18.069418 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e0644253-6577-432b-a809-43d7a8b16820 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:18.070404 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e0644253-6577-432b-a809-43d7a8b16820 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:18.071002 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e0644253-6577-432b-a809-43d7a8b16820 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:18.229490 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-e0644253-6577-432b-a809-43d7a8b16820 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:18.237798 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-e0644253-6577-432b-a809-43d7a8b16820 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/aafabce5-30ac-488a-9d85-2d453337bf71" status: 200 len: 1366 microversion: 2.1 time: 0.180862 May 23 15:45:18.248956 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 223/427] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:18 2022] GET /compute/v2.1/servers/aafabce5-30ac-488a-9d85-2d453337bf71 => generated 1366 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:45:18.837217 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [req-7731ad88-3efa-48c4-92c4-836d01802087 req-b0cb4a5b-5e8e-4659-9ab3-12dc4752101e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aafabce5-30ac-488a-9d85-2d453337bf71", "tag": "835b3c97-b279-41ce-9d47-79f0eb6219e8"}]} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:45:18.851524 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-ee06cbfa-fd82-4679-bbce-12b7e577b87e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "POST /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.479941 May 23 15:45:18.855036 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 205/428] 10.222.0.64 () {60 vars in 1322 bytes} [Mon May 23 15:45:14 2022] POST /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d/os-volume_attachments => generated 194 bytes in 4487 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:45:18.863251 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-02e01d17-74db-4a55-8e57-bfceab2072b3 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:45:18.872866 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-02e01d17-74db-4a55-8e57-bfceab2072b3 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:18.879963 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-02e01d17-74db-4a55-8e57-bfceab2072b3 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:18.883589 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-7731ad88-3efa-48c4-92c4-836d01802087 req-b0cb4a5b-5e8e-4659-9ab3-12dc4752101e service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:18.884045 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-7731ad88-3efa-48c4-92c4-836d01802087 req-b0cb4a5b-5e8e-4659-9ab3-12dc4752101e service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:18.906893 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.compute.server_external_events [req-7731ad88-3efa-48c4-92c4-836d01802087 req-b0cb4a5b-5e8e-4659-9ab3-12dc4752101e service nova] Creating event network-changed:835b3c97-b279-41ce-9d47-79f0eb6219e8 for instance aafabce5-30ac-488a-9d85-2d453337bf71 on hv-cinder-84067 May 23 15:45:18.908179 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-02e01d17-74db-4a55-8e57-bfceab2072b3 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Going to try to stop instance {{(pid=124933) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 23 15:45:18.915404 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [req-7731ad88-3efa-48c4-92c4-836d01802087 req-b0cb4a5b-5e8e-4659-9ab3-12dc4752101e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095061 May 23 15:45:18.926385 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 224/429] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:45:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:45:19.184415 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-02e01d17-74db-4a55-8e57-bfceab2072b3 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "POST /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358/action" status: 202 len: 0 microversion: 2.1 time: 0.326620 May 23 15:45:19.185075 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 206/430] 10.222.0.64 () {60 vars in 1277 bytes} [Mon May 23 15:45:18 2022] POST /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358/action => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 15:45:19.193998 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-de946ffe-99bf-4944-b29c-2de50da78d4b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:19.194703 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-de946ffe-99bf-4944-b29c-2de50da78d4b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:19.201534 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-de946ffe-99bf-4944-b29c-2de50da78d4b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:19.202025 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-de946ffe-99bf-4944-b29c-2de50da78d4b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:19.203002 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-de946ffe-99bf-4944-b29c-2de50da78d4b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:19.203768 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-de946ffe-99bf-4944-b29c-2de50da78d4b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:19.260963 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-175474c7-9504-4509-a389-789ea566c46a tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:19.261694 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-175474c7-9504-4509-a389-789ea566c46a tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: aafabce5-30ac-488a-9d85-2d453337bf71] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:19.278032 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-175474c7-9504-4509-a389-789ea566c46a tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:19.279514 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-175474c7-9504-4509-a389-789ea566c46a tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:19.281343 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-175474c7-9504-4509-a389-789ea566c46a tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:19.282189 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-175474c7-9504-4509-a389-789ea566c46a tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:19.407122 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-de946ffe-99bf-4944-b29c-2de50da78d4b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:19.416574 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-de946ffe-99bf-4944-b29c-2de50da78d4b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 200 len: 1676 microversion: 2.1 time: 0.226865 May 23 15:45:19.418794 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 225/431] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:19 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 1676 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:45:19.462255 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-175474c7-9504-4509-a389-789ea566c46a tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:19.470377 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-175474c7-9504-4509-a389-789ea566c46a tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/aafabce5-30ac-488a-9d85-2d453337bf71" status: 200 len: 1366 microversion: 2.1 time: 0.216592 May 23 15:45:19.470931 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 207/432] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:19 2022] GET /compute/v2.1/servers/aafabce5-30ac-488a-9d85-2d453337bf71 => generated 1366 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:45:20.435185 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-7a262822-5b0b-4401-bc5b-ee791b801a5d tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:20.435868 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-7a262822-5b0b-4401-bc5b-ee791b801a5d tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:20.442304 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-7a262822-5b0b-4401-bc5b-ee791b801a5d tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:20.442794 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-7a262822-5b0b-4401-bc5b-ee791b801a5d tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:20.444431 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-7a262822-5b0b-4401-bc5b-ee791b801a5d tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:20.444885 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-7a262822-5b0b-4401-bc5b-ee791b801a5d tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:20.487946 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-02714d92-cd49-4012-8671-1f9923567723 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:20.488628 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-02714d92-cd49-4012-8671-1f9923567723 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: aafabce5-30ac-488a-9d85-2d453337bf71] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:20.496830 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-02714d92-cd49-4012-8671-1f9923567723 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:20.497314 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-02714d92-cd49-4012-8671-1f9923567723 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:20.498083 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-02714d92-cd49-4012-8671-1f9923567723 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:20.498517 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-02714d92-cd49-4012-8671-1f9923567723 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:20.632494 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-7a262822-5b0b-4401-bc5b-ee791b801a5d tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:20.640188 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-7a262822-5b0b-4401-bc5b-ee791b801a5d tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 200 len: 1676 microversion: 2.1 time: 0.209024 May 23 15:45:20.640758 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 226/433] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:20 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 1676 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:45:20.670237 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-02714d92-cd49-4012-8671-1f9923567723 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:20.678829 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-02714d92-cd49-4012-8671-1f9923567723 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/aafabce5-30ac-488a-9d85-2d453337bf71" status: 200 len: 1366 microversion: 2.1 time: 0.194852 May 23 15:45:20.679521 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 208/434] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:20 2022] GET /compute/v2.1/servers/aafabce5-30ac-488a-9d85-2d453337bf71 => generated 1366 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:45:21.658129 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-9d231750-6e11-4fe4-a216-ff338e18bbb0 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:21.658916 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-9d231750-6e11-4fe4-a216-ff338e18bbb0 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:21.665725 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-9d231750-6e11-4fe4-a216-ff338e18bbb0 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:21.666180 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-9d231750-6e11-4fe4-a216-ff338e18bbb0 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:21.666963 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-9d231750-6e11-4fe4-a216-ff338e18bbb0 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:21.667399 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-9d231750-6e11-4fe4-a216-ff338e18bbb0 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:21.698886 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-bd6b8018-af49-46fa-9f40-5bc32cdf5d37 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:21.700067 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-bd6b8018-af49-46fa-9f40-5bc32cdf5d37 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: aafabce5-30ac-488a-9d85-2d453337bf71] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:21.707390 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-bd6b8018-af49-46fa-9f40-5bc32cdf5d37 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:21.707845 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-bd6b8018-af49-46fa-9f40-5bc32cdf5d37 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:21.708622 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-bd6b8018-af49-46fa-9f40-5bc32cdf5d37 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:21.709986 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-bd6b8018-af49-46fa-9f40-5bc32cdf5d37 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:21.854253 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-9d231750-6e11-4fe4-a216-ff338e18bbb0 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:21.864315 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-9d231750-6e11-4fe4-a216-ff338e18bbb0 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 200 len: 1676 microversion: 2.1 time: 0.209966 May 23 15:45:21.875690 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 227/435] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:21 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 1676 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:45:21.884267 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-bd6b8018-af49-46fa-9f40-5bc32cdf5d37 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:21.891943 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-bd6b8018-af49-46fa-9f40-5bc32cdf5d37 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/aafabce5-30ac-488a-9d85-2d453337bf71" status: 200 len: 1366 microversion: 2.1 time: 0.201186 May 23 15:45:21.892513 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 209/436] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:21 2022] GET /compute/v2.1/servers/aafabce5-30ac-488a-9d85-2d453337bf71 => generated 1366 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:45:22.882212 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-8171c011-d7ca-4690-a7a5-03fa86f19418 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:22.882793 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-8171c011-d7ca-4690-a7a5-03fa86f19418 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:22.888666 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-8171c011-d7ca-4690-a7a5-03fa86f19418 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:22.889154 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-8171c011-d7ca-4690-a7a5-03fa86f19418 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:22.889929 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-8171c011-d7ca-4690-a7a5-03fa86f19418 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:22.890555 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-8171c011-d7ca-4690-a7a5-03fa86f19418 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:22.910190 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-11d4a533-5127-48db-9f19-2239a3259a6c tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:22.911170 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-11d4a533-5127-48db-9f19-2239a3259a6c tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: aafabce5-30ac-488a-9d85-2d453337bf71] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:22.920915 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-11d4a533-5127-48db-9f19-2239a3259a6c tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:22.921647 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-11d4a533-5127-48db-9f19-2239a3259a6c tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:22.925162 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-11d4a533-5127-48db-9f19-2239a3259a6c tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:22.925645 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-11d4a533-5127-48db-9f19-2239a3259a6c tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:23.320365 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-8171c011-d7ca-4690-a7a5-03fa86f19418 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:23.324431 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-11d4a533-5127-48db-9f19-2239a3259a6c tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:23.327976 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-8171c011-d7ca-4690-a7a5-03fa86f19418 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 200 len: 1676 microversion: 2.1 time: 0.449746 May 23 15:45:23.331082 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 228/437] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:22 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 1676 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:45:23.331982 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-11d4a533-5127-48db-9f19-2239a3259a6c tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/aafabce5-30ac-488a-9d85-2d453337bf71" status: 200 len: 1366 microversion: 2.1 time: 0.427067 May 23 15:45:23.332708 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 210/438] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:22 2022] GET /compute/v2.1/servers/aafabce5-30ac-488a-9d85-2d453337bf71 => generated 1366 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:45:24.348697 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-85b4feea-13b5-4a85-9f6e-0855bf69e4fe tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:24.349556 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-a28192f9-9d2f-4ac9-a3bd-7fb6cf886f49 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:24.349556 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-a28192f9-9d2f-4ac9-a3bd-7fb6cf886f49 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:24.350665 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-85b4feea-13b5-4a85-9f6e-0855bf69e4fe tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: aafabce5-30ac-488a-9d85-2d453337bf71] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:24.356063 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-a28192f9-9d2f-4ac9-a3bd-7fb6cf886f49 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:24.356525 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-a28192f9-9d2f-4ac9-a3bd-7fb6cf886f49 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:24.356742 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-85b4feea-13b5-4a85-9f6e-0855bf69e4fe tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:24.357227 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-85b4feea-13b5-4a85-9f6e-0855bf69e4fe tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:24.357353 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-a28192f9-9d2f-4ac9-a3bd-7fb6cf886f49 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:24.357761 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-a28192f9-9d2f-4ac9-a3bd-7fb6cf886f49 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:24.357987 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-85b4feea-13b5-4a85-9f6e-0855bf69e4fe tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:24.358419 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-85b4feea-13b5-4a85-9f6e-0855bf69e4fe tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:24.562311 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-a28192f9-9d2f-4ac9-a3bd-7fb6cf886f49 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:24.567078 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-85b4feea-13b5-4a85-9f6e-0855bf69e4fe tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:24.571322 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-a28192f9-9d2f-4ac9-a3bd-7fb6cf886f49 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 200 len: 1676 microversion: 2.1 time: 0.226386 May 23 15:45:24.572161 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 229/439] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:24 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 1676 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:45:24.579010 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-85b4feea-13b5-4a85-9f6e-0855bf69e4fe tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/aafabce5-30ac-488a-9d85-2d453337bf71" status: 200 len: 1366 microversion: 2.1 time: 0.230588 May 23 15:45:24.579010 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 211/440] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:24 2022] GET /compute/v2.1/servers/aafabce5-30ac-488a-9d85-2d453337bf71 => generated 1366 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:45:24.875678 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [req-709ad5fd-32b8-489f-af9a-b3e6ad8dcf0d req-ee9ce1d7-565c-4a3b-9f77-8e039cd72d78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aafabce5-30ac-488a-9d85-2d453337bf71", "name": "network-vif-plugged", "status": "completed", "tag": "835b3c97-b279-41ce-9d47-79f0eb6219e8"}]} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:45:24.884695 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-709ad5fd-32b8-489f-af9a-b3e6ad8dcf0d req-ee9ce1d7-565c-4a3b-9f77-8e039cd72d78 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:24.885184 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-709ad5fd-32b8-489f-af9a-b3e6ad8dcf0d req-ee9ce1d7-565c-4a3b-9f77-8e039cd72d78 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:24.896294 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.compute.server_external_events [req-709ad5fd-32b8-489f-af9a-b3e6ad8dcf0d req-ee9ce1d7-565c-4a3b-9f77-8e039cd72d78 service nova] Creating event network-vif-plugged:835b3c97-b279-41ce-9d47-79f0eb6219e8 for instance aafabce5-30ac-488a-9d85-2d453337bf71 on hv-cinder-84067 May 23 15:45:24.901107 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [req-709ad5fd-32b8-489f-af9a-b3e6ad8dcf0d req-ee9ce1d7-565c-4a3b-9f77-8e039cd72d78 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029133 May 23 15:45:24.901745 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 230/441] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:45:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:45:25.588657 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-77d93236-1486-4483-95a2-467e07af214c tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:25.589233 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_cell0:SELECT=4 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:25.589862 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-77d93236-1486-4483-95a2-467e07af214c tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:25.593082 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-15aaf0f3-fce9-4fa2-9f36-1072e90fd897 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:25.593781 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-15aaf0f3-fce9-4fa2-9f36-1072e90fd897 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: aafabce5-30ac-488a-9d85-2d453337bf71] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:25.596730 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-77d93236-1486-4483-95a2-467e07af214c tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:25.597214 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-77d93236-1486-4483-95a2-467e07af214c tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:25.597991 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-77d93236-1486-4483-95a2-467e07af214c tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:25.598431 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-77d93236-1486-4483-95a2-467e07af214c tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:25.599746 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-15aaf0f3-fce9-4fa2-9f36-1072e90fd897 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:25.600281 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-15aaf0f3-fce9-4fa2-9f36-1072e90fd897 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:25.601130 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-15aaf0f3-fce9-4fa2-9f36-1072e90fd897 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:25.601570 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-15aaf0f3-fce9-4fa2-9f36-1072e90fd897 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:25.821717 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-77d93236-1486-4483-95a2-467e07af214c tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:25.826460 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-15aaf0f3-fce9-4fa2-9f36-1072e90fd897 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:25.829196 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-77d93236-1486-4483-95a2-467e07af214c tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 200 len: 1676 microversion: 2.1 time: 0.244469 May 23 15:45:25.829763 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 212/442] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:25 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 1676 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:45:25.834101 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-15aaf0f3-fce9-4fa2-9f36-1072e90fd897 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/aafabce5-30ac-488a-9d85-2d453337bf71" status: 200 len: 1366 microversion: 2.1 time: 0.246036 May 23 15:45:25.834645 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 231/443] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:25 2022] GET /compute/v2.1/servers/aafabce5-30ac-488a-9d85-2d453337bf71 => generated 1366 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:45:26.848915 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-e78aa9fd-98a4-4b1b-9215-43ab254c9b46 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:26.850119 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-e78aa9fd-98a4-4b1b-9215-43ab254c9b46 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:26.851631 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-8e80efef-1f2e-4bee-a70e-59fffc12faa6 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:26.852249 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-8e80efef-1f2e-4bee-a70e-59fffc12faa6 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: aafabce5-30ac-488a-9d85-2d453337bf71] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:26.856709 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e78aa9fd-98a4-4b1b-9215-43ab254c9b46 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:26.857223 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e78aa9fd-98a4-4b1b-9215-43ab254c9b46 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:26.858168 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e78aa9fd-98a4-4b1b-9215-43ab254c9b46 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:26.858286 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-8e80efef-1f2e-4bee-a70e-59fffc12faa6 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:26.858614 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e78aa9fd-98a4-4b1b-9215-43ab254c9b46 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:26.858723 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-8e80efef-1f2e-4bee-a70e-59fffc12faa6 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:26.859380 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-8e80efef-1f2e-4bee-a70e-59fffc12faa6 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:26.859861 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-8e80efef-1f2e-4bee-a70e-59fffc12faa6 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:26.862591 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:27.064530 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-8e80efef-1f2e-4bee-a70e-59fffc12faa6 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:27.067860 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-e78aa9fd-98a4-4b1b-9215-43ab254c9b46 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:27.074514 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-8e80efef-1f2e-4bee-a70e-59fffc12faa6 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/aafabce5-30ac-488a-9d85-2d453337bf71" status: 200 len: 1366 microversion: 2.1 time: 0.227462 May 23 15:45:27.075120 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 232/444] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:26 2022] GET /compute/v2.1/servers/aafabce5-30ac-488a-9d85-2d453337bf71 => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:45:27.078582 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-e78aa9fd-98a4-4b1b-9215-43ab254c9b46 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 200 len: 1676 microversion: 2.1 time: 0.234679 May 23 15:45:27.079152 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 213/445] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:26 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 1676 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:45:28.091389 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-4d7b3ba0-0e3d-44c0-bd66-f5c7fc953337 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:28.092007 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-4d7b3ba0-0e3d-44c0-bd66-f5c7fc953337 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: aafabce5-30ac-488a-9d85-2d453337bf71] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:28.094932 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-ab76f082-ef6c-488b-8456-2e3811dee062 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:28.095695 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-ab76f082-ef6c-488b-8456-2e3811dee062 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:28.098934 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4d7b3ba0-0e3d-44c0-bd66-f5c7fc953337 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:28.100004 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4d7b3ba0-0e3d-44c0-bd66-f5c7fc953337 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:28.101158 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4d7b3ba0-0e3d-44c0-bd66-f5c7fc953337 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:28.101606 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4d7b3ba0-0e3d-44c0-bd66-f5c7fc953337 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:28.103907 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ab76f082-ef6c-488b-8456-2e3811dee062 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:28.104436 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ab76f082-ef6c-488b-8456-2e3811dee062 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:28.105479 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ab76f082-ef6c-488b-8456-2e3811dee062 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:28.106117 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ab76f082-ef6c-488b-8456-2e3811dee062 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:28.106527 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_cell1:SELECT=100 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:28.313437 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-4d7b3ba0-0e3d-44c0-bd66-f5c7fc953337 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:28.321424 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-ab76f082-ef6c-488b-8456-2e3811dee062 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:28.321956 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-4d7b3ba0-0e3d-44c0-bd66-f5c7fc953337 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/aafabce5-30ac-488a-9d85-2d453337bf71" status: 200 len: 1556 microversion: 2.1 time: 0.234680 May 23 15:45:28.326242 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 233/446] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:28 2022] GET /compute/v2.1/servers/aafabce5-30ac-488a-9d85-2d453337bf71 => generated 1556 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:45:28.329422 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-ab76f082-ef6c-488b-8456-2e3811dee062 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 200 len: 1676 microversion: 2.1 time: 0.238623 May 23 15:45:28.329983 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 214/447] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:28 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 1676 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:45:28.338803 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-de2c80ca-c13b-4159-b426-d0e0c7f682aa tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:28.339590 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-de2c80ca-c13b-4159-b426-d0e0c7f682aa tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: aafabce5-30ac-488a-9d85-2d453337bf71] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:28.346073 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-de2c80ca-c13b-4159-b426-d0e0c7f682aa tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:28.346539 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-de2c80ca-c13b-4159-b426-d0e0c7f682aa tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:28.347595 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-de2c80ca-c13b-4159-b426-d0e0c7f682aa tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:28.348133 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-de2c80ca-c13b-4159-b426-d0e0c7f682aa tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:28.431787 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-de2c80ca-c13b-4159-b426-d0e0c7f682aa tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/aafabce5-30ac-488a-9d85-2d453337bf71/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096632 May 23 15:45:28.432419 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 234/448] 10.222.0.64 () {58 vars in 1274 bytes} [Mon May 23 15:45:28 2022] GET /compute/v2.1/servers/aafabce5-30ac-488a-9d85-2d453337bf71/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:45:28.553594 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-56b3a1f2-cf30-4f77-8625-6651b209f1d7 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:45:28.554781 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-56b3a1f2-cf30-4f77-8625-6651b209f1d7 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 15c3a3b9-3d55-44c3-8627-ba397c1f069d] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:28.561186 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-56b3a1f2-cf30-4f77-8625-6651b209f1d7 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:28.561650 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-56b3a1f2-cf30-4f77-8625-6651b209f1d7 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:28.562467 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-56b3a1f2-cf30-4f77-8625-6651b209f1d7 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:28.562907 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-56b3a1f2-cf30-4f77-8625-6651b209f1d7 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:28.586503 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.objects.instance [None req-56b3a1f2-cf30-4f77-8625-6651b209f1d7 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lazy-loading 'flavor' on Instance uuid 15c3a3b9-3d55-44c3-8627-ba397c1f069d {{(pid=124933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 15:45:28.926620 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-56b3a1f2-cf30-4f77-8625-6651b209f1d7 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "POST /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d/action" status: 200 len: 32 microversion: 2.1 time: 0.377675 May 23 15:45:28.927260 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 215/449] 10.222.0.64 () {60 vars in 1277 bytes} [Mon May 23 15:45:28 2022] POST /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d/action => generated 32 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 15:45:28.937306 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-7225257a-b71b-4915-b90f-994217f3c4e2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:28.937927 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-7225257a-b71b-4915-b90f-994217f3c4e2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 15c3a3b9-3d55-44c3-8627-ba397c1f069d] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:28.944688 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-7225257a-b71b-4915-b90f-994217f3c4e2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:28.945193 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-7225257a-b71b-4915-b90f-994217f3c4e2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:28.945972 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-7225257a-b71b-4915-b90f-994217f3c4e2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:28.946416 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-7225257a-b71b-4915-b90f-994217f3c4e2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:29.165886 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-7225257a-b71b-4915-b90f-994217f3c4e2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:29.174449 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-7225257a-b71b-4915-b90f-994217f3c4e2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d" status: 200 len: 1732 microversion: 2.1 time: 0.241069 May 23 15:45:29.174951 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 235/450] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:28 2022] GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d => generated 1732 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:45:29.349901 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-5e42648d-230d-4b0b-ab8a-bba8ca4ddd79 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:29.352645 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-5e42648d-230d-4b0b-ab8a-bba8ca4ddd79 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:29.361295 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-5e42648d-230d-4b0b-ab8a-bba8ca4ddd79 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:29.361742 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-5e42648d-230d-4b0b-ab8a-bba8ca4ddd79 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:29.362519 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-5e42648d-230d-4b0b-ab8a-bba8ca4ddd79 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:29.362947 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-5e42648d-230d-4b0b-ab8a-bba8ca4ddd79 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:29.619105 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-5e42648d-230d-4b0b-ab8a-bba8ca4ddd79 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:29.626244 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-5e42648d-230d-4b0b-ab8a-bba8ca4ddd79 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 200 len: 1676 microversion: 2.1 time: 0.283091 May 23 15:45:29.627034 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 216/451] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:29 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 1676 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:45:29.752609 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [req-74967b82-4edc-49f6-bd3d-27da978c3f78 req-d4e431d1-b978-4478-bbac-1d4235b4ee99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aafabce5-30ac-488a-9d85-2d453337bf71", "tag": "835b3c97-b279-41ce-9d47-79f0eb6219e8"}]} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:45:29.770731 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-74967b82-4edc-49f6-bd3d-27da978c3f78 req-d4e431d1-b978-4478-bbac-1d4235b4ee99 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:29.772853 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-74967b82-4edc-49f6-bd3d-27da978c3f78 req-d4e431d1-b978-4478-bbac-1d4235b4ee99 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:29.793096 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.compute.server_external_events [req-74967b82-4edc-49f6-bd3d-27da978c3f78 req-d4e431d1-b978-4478-bbac-1d4235b4ee99 service nova] Creating event network-changed:835b3c97-b279-41ce-9d47-79f0eb6219e8 for instance aafabce5-30ac-488a-9d85-2d453337bf71 on hv-cinder-84067 May 23 15:45:29.799440 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [req-74967b82-4edc-49f6-bd3d-27da978c3f78 req-d4e431d1-b978-4478-bbac-1d4235b4ee99 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051589 May 23 15:45:29.801487 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 236/452] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:45:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:45:30.192039 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-668a33b2-fb16-483b-917c-7139c255e927 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:30.192652 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-668a33b2-fb16-483b-917c-7139c255e927 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 15c3a3b9-3d55-44c3-8627-ba397c1f069d] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:30.199762 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-668a33b2-fb16-483b-917c-7139c255e927 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:30.200590 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-668a33b2-fb16-483b-917c-7139c255e927 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:30.201564 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-668a33b2-fb16-483b-917c-7139c255e927 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:30.202246 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-668a33b2-fb16-483b-917c-7139c255e927 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:30.431918 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-668a33b2-fb16-483b-917c-7139c255e927 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:30.440282 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-668a33b2-fb16-483b-917c-7139c255e927 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d" status: 200 len: 1732 microversion: 2.1 time: 0.251852 May 23 15:45:30.441489 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 217/453] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:30 2022] GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d => generated 1732 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:45:30.644715 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-c9756135-6808-47cd-8ef5-3c3c4db693dc tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:30.645456 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-c9756135-6808-47cd-8ef5-3c3c4db693dc tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:30.651729 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-c9756135-6808-47cd-8ef5-3c3c4db693dc tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:30.652196 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-c9756135-6808-47cd-8ef5-3c3c4db693dc tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:30.652992 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-c9756135-6808-47cd-8ef5-3c3c4db693dc tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:30.653465 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-c9756135-6808-47cd-8ef5-3c3c4db693dc tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:31.008804 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-c9756135-6808-47cd-8ef5-3c3c4db693dc tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:31.016181 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-c9756135-6808-47cd-8ef5-3c3c4db693dc tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 200 len: 1653 microversion: 2.1 time: 0.375739 May 23 15:45:31.016837 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 237/454] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:30 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 1653 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:45:31.033377 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-4106b214-7ff2-4a52-b6ac-2807f14e4a8e tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:45:31.040337 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-4106b214-7ff2-4a52-b6ac-2807f14e4a8e tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:31.040786 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-4106b214-7ff2-4a52-b6ac-2807f14e4a8e tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:31.062321 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-4106b214-7ff2-4a52-b6ac-2807f14e4a8e tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Going to try to start instance {{(pid=124933) start /opt/stack/nova/nova/compute/api.py:2730}} May 23 15:45:31.187957 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-4106b214-7ff2-4a52-b6ac-2807f14e4a8e tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "POST /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358/action" status: 202 len: 0 microversion: 2.1 time: 0.158188 May 23 15:45:31.188708 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 218/455] 10.222.0.64 () {60 vars in 1277 bytes} [Mon May 23 15:45:31 2022] POST /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 23 15:45:31.197928 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-071e0a37-8651-41d6-8075-a87b88fb373f tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:31.198575 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-071e0a37-8651-41d6-8075-a87b88fb373f tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:31.204464 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-071e0a37-8651-41d6-8075-a87b88fb373f tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:31.204913 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-071e0a37-8651-41d6-8075-a87b88fb373f tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:31.205708 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-071e0a37-8651-41d6-8075-a87b88fb373f tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:31.206144 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-071e0a37-8651-41d6-8075-a87b88fb373f tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:31.335444 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-071e0a37-8651-41d6-8075-a87b88fb373f tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:31.344391 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-071e0a37-8651-41d6-8075-a87b88fb373f tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 200 len: 1662 microversion: 2.1 time: 0.151080 May 23 15:45:31.344952 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 238/456] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:31 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 1662 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:45:31.460259 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-b5526da2-5153-45c5-a25e-46a9b55566f9 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:31.460905 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-b5526da2-5153-45c5-a25e-46a9b55566f9 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 15c3a3b9-3d55-44c3-8627-ba397c1f069d] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:31.467315 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b5526da2-5153-45c5-a25e-46a9b55566f9 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:31.467770 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b5526da2-5153-45c5-a25e-46a9b55566f9 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:31.468547 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b5526da2-5153-45c5-a25e-46a9b55566f9 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:31.468985 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b5526da2-5153-45c5-a25e-46a9b55566f9 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:31.605884 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-b5526da2-5153-45c5-a25e-46a9b55566f9 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:31.613867 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-b5526da2-5153-45c5-a25e-46a9b55566f9 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d" status: 200 len: 1732 microversion: 2.1 time: 0.158957 May 23 15:45:31.614432 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 219/457] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:31 2022] GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:45:32.361649 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-317d9085-9fa9-4cb9-90e3-475dea4a06c6 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:32.362281 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-317d9085-9fa9-4cb9-90e3-475dea4a06c6 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:32.368777 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-317d9085-9fa9-4cb9-90e3-475dea4a06c6 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:32.369274 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-317d9085-9fa9-4cb9-90e3-475dea4a06c6 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:32.370038 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-317d9085-9fa9-4cb9-90e3-475dea4a06c6 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:32.370476 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-317d9085-9fa9-4cb9-90e3-475dea4a06c6 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:32.505473 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-317d9085-9fa9-4cb9-90e3-475dea4a06c6 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:32.513658 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-317d9085-9fa9-4cb9-90e3-475dea4a06c6 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 200 len: 1662 microversion: 2.1 time: 0.155892 May 23 15:45:32.514221 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 239/458] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:32 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 1662 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:45:32.631407 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-e692bbdd-9a43-48cb-a92e-27995077f615 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:32.631948 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-e692bbdd-9a43-48cb-a92e-27995077f615 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 15c3a3b9-3d55-44c3-8627-ba397c1f069d] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:32.638260 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e692bbdd-9a43-48cb-a92e-27995077f615 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:32.638707 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e692bbdd-9a43-48cb-a92e-27995077f615 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:32.639468 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e692bbdd-9a43-48cb-a92e-27995077f615 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:32.639897 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e692bbdd-9a43-48cb-a92e-27995077f615 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:32.772701 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-e692bbdd-9a43-48cb-a92e-27995077f615 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:32.780722 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-e692bbdd-9a43-48cb-a92e-27995077f615 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d" status: 200 len: 1732 microversion: 2.1 time: 0.153150 May 23 15:45:32.781331 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 220/459] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:32 2022] GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:45:33.531614 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-773a4351-e633-4271-8c38-fa01f18d8cc4 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:33.532204 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-773a4351-e633-4271-8c38-fa01f18d8cc4 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:33.534162 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=2 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:33.539421 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-773a4351-e633-4271-8c38-fa01f18d8cc4 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:33.539867 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-773a4351-e633-4271-8c38-fa01f18d8cc4 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:33.540618 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-773a4351-e633-4271-8c38-fa01f18d8cc4 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:33.541191 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-773a4351-e633-4271-8c38-fa01f18d8cc4 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:33.668803 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-773a4351-e633-4271-8c38-fa01f18d8cc4 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:33.676519 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-773a4351-e633-4271-8c38-fa01f18d8cc4 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 200 len: 1666 microversion: 2.1 time: 0.148720 May 23 15:45:33.677073 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 240/460] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:33 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 1666 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:45:33.798115 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-73eefb65-a682-4e50-a57f-8e68231cf280 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:33.798651 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-73eefb65-a682-4e50-a57f-8e68231cf280 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 15c3a3b9-3d55-44c3-8627-ba397c1f069d] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:33.801012 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:33.805772 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-73eefb65-a682-4e50-a57f-8e68231cf280 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:33.806216 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-73eefb65-a682-4e50-a57f-8e68231cf280 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:33.806980 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-73eefb65-a682-4e50-a57f-8e68231cf280 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:33.807451 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-73eefb65-a682-4e50-a57f-8e68231cf280 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:33.936095 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-73eefb65-a682-4e50-a57f-8e68231cf280 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:33.944043 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-73eefb65-a682-4e50-a57f-8e68231cf280 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d" status: 200 len: 1732 microversion: 2.1 time: 0.150040 May 23 15:45:33.944597 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 221/461] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:33 2022] GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:45:34.961149 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-5cd4dd0c-fa87-458c-8ad7-4b24fde97d4c tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:34.961682 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-5cd4dd0c-fa87-458c-8ad7-4b24fde97d4c tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 15c3a3b9-3d55-44c3-8627-ba397c1f069d] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:34.967786 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5cd4dd0c-fa87-458c-8ad7-4b24fde97d4c tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:34.968234 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5cd4dd0c-fa87-458c-8ad7-4b24fde97d4c tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:34.968988 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5cd4dd0c-fa87-458c-8ad7-4b24fde97d4c tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:34.969446 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5cd4dd0c-fa87-458c-8ad7-4b24fde97d4c tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:35.095147 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-5cd4dd0c-fa87-458c-8ad7-4b24fde97d4c tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:35.104412 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-5cd4dd0c-fa87-458c-8ad7-4b24fde97d4c tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d" status: 200 len: 1732 microversion: 2.1 time: 0.147151 May 23 15:45:35.104966 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 241/462] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:34 2022] GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d => generated 1732 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:45:35.903623 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-595edef5-8ecf-4b77-b923-8e6d8d1b1938 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1367278630", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1689259836", "security_groups": [{"name": "tempest-secgroup-smoke-2071772138"}], "block_device_mapping_v2": [{"uuid": "7eebe9cc-0657-4ce9-b9e4-ac251d56a096", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "719fa7d2-b22e-4ff9-afc9-c7cbf4d644a6"}]}} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:45:36.012787 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.network.neutron [None req-595edef5-8ecf-4b77-b923-8e6d8d1b1938 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] validate_networks() for [('719fa7d2-b22e-4ff9-afc9-c7cbf4d644a6', None, None, None, None, None)] {{(pid=124933) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 15:45:36.122011 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-68172791-30df-402f-a4c4-e32600c1d87e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:36.122632 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-68172791-30df-402f-a4c4-e32600c1d87e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 15c3a3b9-3d55-44c3-8627-ba397c1f069d] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:36.128771 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-68172791-30df-402f-a4c4-e32600c1d87e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:36.129268 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-68172791-30df-402f-a4c4-e32600c1d87e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:36.130244 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-68172791-30df-402f-a4c4-e32600c1d87e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:36.130693 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-68172791-30df-402f-a4c4-e32600c1d87e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:36.330024 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-68172791-30df-402f-a4c4-e32600c1d87e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:36.338038 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-68172791-30df-402f-a4c4-e32600c1d87e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d" status: 200 len: 1732 microversion: 2.1 time: 0.219856 May 23 15:45:36.338609 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 242/463] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:36 2022] GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d => generated 1732 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:45:36.440918 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.virt.hardware [None req-595edef5-8ecf-4b77-b923-8e6d8d1b1938 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Flavor limits 0:0:0 {{(pid=124933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 15:45:36.441377 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.virt.hardware [None req-595edef5-8ecf-4b77-b923-8e6d8d1b1938 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Image limits 0:0:0 {{(pid=124933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 15:45:36.441855 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.virt.hardware [None req-595edef5-8ecf-4b77-b923-8e6d8d1b1938 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Flavor pref 0:0:0 {{(pid=124933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 15:45:36.442295 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.virt.hardware [None req-595edef5-8ecf-4b77-b923-8e6d8d1b1938 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Image pref 0:0:0 {{(pid=124933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 15:45:36.442737 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.virt.hardware [None req-595edef5-8ecf-4b77-b923-8e6d8d1b1938 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 15:45:36.452203 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-595edef5-8ecf-4b77-b923-8e6d8d1b1938 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:36.452653 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-595edef5-8ecf-4b77-b923-8e6d8d1b1938 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:36.453496 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-595edef5-8ecf-4b77-b923-8e6d8d1b1938 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:36.453974 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-595edef5-8ecf-4b77-b923-8e6d8d1b1938 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:36.470945 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.quota [None req-595edef5-8ecf-4b77-b923-8e6d8d1b1938 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Getting quotas for project 6263581d20ea47bcae22d736f7934e05. Resources: {'ram', 'instances', 'cores'} {{(pid=124933) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 15:45:36.474845 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.quota [None req-595edef5-8ecf-4b77-b923-8e6d8d1b1938 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Getting quotas for user ba0229c6732541b4a6dda9040c038686 and project 6263581d20ea47bcae22d736f7934e05. Resources: {'ram', 'instances', 'cores'} {{(pid=124933) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 15:45:36.531641 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-595edef5-8ecf-4b77-b923-8e6d8d1b1938 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Going to run 1 instances... {{(pid=124933) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 15:45:36.533725 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-595edef5-8ecf-4b77-b923-8e6d8d1b1938 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: 54ec3019-6a8e-4080-a386-3894a165c7eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7eebe9cc-0657-4ce9-b9e4-ac251d56a096',volume_size=None,volume_type=None)] {{(pid=124933) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 15:45:36.855491 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-595edef5-8ecf-4b77-b923-8e6d8d1b1938 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.955661 May 23 15:45:36.856047 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 222/464] 10.222.0.64 () {60 vars in 1146 bytes} [Mon May 23 15:45:35 2022] POST /compute/v2.1/servers => generated 406 bytes in 957 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 15:45:36.865920 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-8eae3586-5f08-4f6a-8cae-5adc7dd50b20 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:36.866566 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-8eae3586-5f08-4f6a-8cae-5adc7dd50b20 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: 54ec3019-6a8e-4080-a386-3894a165c7eb] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:36.919683 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-8eae3586-5f08-4f6a-8cae-5adc7dd50b20 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:36.927615 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-8eae3586-5f08-4f6a-8cae-5adc7dd50b20 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/54ec3019-6a8e-4080-a386-3894a165c7eb" status: 200 len: 1095 microversion: 2.1 time: 0.065562 May 23 15:45:36.928564 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 243/465] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:36 2022] GET /compute/v2.1/servers/54ec3019-6a8e-4080-a386-3894a165c7eb => generated 1095 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:45:37.355966 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-1a01405d-a270-41c6-97e6-29afd0d3c87d tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:37.356581 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-1a01405d-a270-41c6-97e6-29afd0d3c87d tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 15c3a3b9-3d55-44c3-8627-ba397c1f069d] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:37.363236 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1a01405d-a270-41c6-97e6-29afd0d3c87d tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:37.363691 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1a01405d-a270-41c6-97e6-29afd0d3c87d tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:37.364464 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1a01405d-a270-41c6-97e6-29afd0d3c87d tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:37.364905 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1a01405d-a270-41c6-97e6-29afd0d3c87d tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:37.492111 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-1a01405d-a270-41c6-97e6-29afd0d3c87d tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:37.500520 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-1a01405d-a270-41c6-97e6-29afd0d3c87d tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d" status: 200 len: 1732 microversion: 2.1 time: 0.149147 May 23 15:45:37.501110 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 223/466] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:37 2022] GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d => generated 1732 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:45:37.944209 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-f0259357-ada6-436a-be28-f86f503f5c2d tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:37.945452 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-f0259357-ada6-436a-be28-f86f503f5c2d tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: 54ec3019-6a8e-4080-a386-3894a165c7eb] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:37.951955 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-f0259357-ada6-436a-be28-f86f503f5c2d tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:37.952408 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-f0259357-ada6-436a-be28-f86f503f5c2d tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:37.953208 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-f0259357-ada6-436a-be28-f86f503f5c2d tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:37.953724 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-f0259357-ada6-436a-be28-f86f503f5c2d tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:38.014751 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-f0259357-ada6-436a-be28-f86f503f5c2d tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:38.022498 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-f0259357-ada6-436a-be28-f86f503f5c2d tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/54ec3019-6a8e-4080-a386-3894a165c7eb" status: 200 len: 1145 microversion: 2.1 time: 0.081917 May 23 15:45:38.023126 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 244/467] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:37 2022] GET /compute/v2.1/servers/54ec3019-6a8e-4080-a386-3894a165c7eb => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:45:38.518585 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-69d74cd4-98c6-457a-968d-86aff6b776d5 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:38.519153 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-69d74cd4-98c6-457a-968d-86aff6b776d5 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 15c3a3b9-3d55-44c3-8627-ba397c1f069d] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:38.526273 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-69d74cd4-98c6-457a-968d-86aff6b776d5 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:38.526726 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-69d74cd4-98c6-457a-968d-86aff6b776d5 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:38.527490 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-69d74cd4-98c6-457a-968d-86aff6b776d5 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:38.527927 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-69d74cd4-98c6-457a-968d-86aff6b776d5 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:38.658522 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-69d74cd4-98c6-457a-968d-86aff6b776d5 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:38.667010 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-69d74cd4-98c6-457a-968d-86aff6b776d5 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d" status: 200 len: 1732 microversion: 2.1 time: 0.152406 May 23 15:45:38.667576 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 224/468] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:38 2022] GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:45:39.039241 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-326a75e3-d7a2-4044-bfd1-cdd8bb44dc05 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:39.039931 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-326a75e3-d7a2-4044-bfd1-cdd8bb44dc05 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: 54ec3019-6a8e-4080-a386-3894a165c7eb] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:39.046047 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-326a75e3-d7a2-4044-bfd1-cdd8bb44dc05 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:39.046513 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-326a75e3-d7a2-4044-bfd1-cdd8bb44dc05 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:39.047293 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-326a75e3-d7a2-4044-bfd1-cdd8bb44dc05 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:39.048032 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-326a75e3-d7a2-4044-bfd1-cdd8bb44dc05 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:39.109343 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-326a75e3-d7a2-4044-bfd1-cdd8bb44dc05 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:39.117813 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-326a75e3-d7a2-4044-bfd1-cdd8bb44dc05 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/54ec3019-6a8e-4080-a386-3894a165c7eb" status: 200 len: 1201 microversion: 2.1 time: 0.082355 May 23 15:45:39.118415 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 245/469] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:39 2022] GET /compute/v2.1/servers/54ec3019-6a8e-4080-a386-3894a165c7eb => generated 1201 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:45:39.685202 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-159b452e-ee43-4d4c-bf8a-b1fd1459f4ee tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:39.685738 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-159b452e-ee43-4d4c-bf8a-b1fd1459f4ee tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 15c3a3b9-3d55-44c3-8627-ba397c1f069d] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:39.692116 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-159b452e-ee43-4d4c-bf8a-b1fd1459f4ee tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:39.692568 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-159b452e-ee43-4d4c-bf8a-b1fd1459f4ee tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:39.693404 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-159b452e-ee43-4d4c-bf8a-b1fd1459f4ee tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:39.693918 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-159b452e-ee43-4d4c-bf8a-b1fd1459f4ee tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:39.828553 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-159b452e-ee43-4d4c-bf8a-b1fd1459f4ee tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:39.840863 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-159b452e-ee43-4d4c-bf8a-b1fd1459f4ee tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d" status: 200 len: 1732 microversion: 2.1 time: 0.159634 May 23 15:45:39.852370 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 225/470] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:39 2022] GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d => generated 1732 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:45:40.136052 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-1f81b371-d607-4c87-9e43-51e1b684840a tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:40.136772 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-1f81b371-d607-4c87-9e43-51e1b684840a tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: 54ec3019-6a8e-4080-a386-3894a165c7eb] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:40.143027 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-1f81b371-d607-4c87-9e43-51e1b684840a tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:40.143545 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-1f81b371-d607-4c87-9e43-51e1b684840a tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:40.144439 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-1f81b371-d607-4c87-9e43-51e1b684840a tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:40.144926 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-1f81b371-d607-4c87-9e43-51e1b684840a tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:40.284930 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-1f81b371-d607-4c87-9e43-51e1b684840a tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:40.293560 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-1f81b371-d607-4c87-9e43-51e1b684840a tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/54ec3019-6a8e-4080-a386-3894a165c7eb" status: 200 len: 1279 microversion: 2.1 time: 0.162467 May 23 15:45:40.294116 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 246/471] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:40 2022] GET /compute/v2.1/servers/54ec3019-6a8e-4080-a386-3894a165c7eb => generated 1279 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:45:40.811830 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [req-8a6b91ff-24a0-4f46-93ef-217d64308f22 req-17b0fd85-0113-4ebd-82cc-d41c90c29a46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54ec3019-6a8e-4080-a386-3894a165c7eb", "tag": "9998b808-7746-404c-a44c-c2b50e15e918"}]} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:45:40.820909 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-8a6b91ff-24a0-4f46-93ef-217d64308f22 req-17b0fd85-0113-4ebd-82cc-d41c90c29a46 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:40.821390 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-8a6b91ff-24a0-4f46-93ef-217d64308f22 req-17b0fd85-0113-4ebd-82cc-d41c90c29a46 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:40.841020 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.compute.server_external_events [req-8a6b91ff-24a0-4f46-93ef-217d64308f22 req-17b0fd85-0113-4ebd-82cc-d41c90c29a46 service nova] Creating event network-changed:9998b808-7746-404c-a44c-c2b50e15e918 for instance 54ec3019-6a8e-4080-a386-3894a165c7eb on hv-cinder-84067 May 23 15:45:40.846720 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [req-8a6b91ff-24a0-4f46-93ef-217d64308f22 req-17b0fd85-0113-4ebd-82cc-d41c90c29a46 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038479 May 23 15:45:40.847322 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 226/472] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:45:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:45:40.858471 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-5fcf78e7-a571-488a-8ceb-9cc214dfa5ed tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:40.860000 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-5fcf78e7-a571-488a-8ceb-9cc214dfa5ed tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 15c3a3b9-3d55-44c3-8627-ba397c1f069d] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:40.866373 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5fcf78e7-a571-488a-8ceb-9cc214dfa5ed tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:40.866818 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5fcf78e7-a571-488a-8ceb-9cc214dfa5ed tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:40.867597 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5fcf78e7-a571-488a-8ceb-9cc214dfa5ed tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:40.868095 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5fcf78e7-a571-488a-8ceb-9cc214dfa5ed tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:41.013007 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-5fcf78e7-a571-488a-8ceb-9cc214dfa5ed tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:41.021205 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-5fcf78e7-a571-488a-8ceb-9cc214dfa5ed tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d" status: 200 len: 1732 microversion: 2.1 time: 0.166690 May 23 15:45:41.021774 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 247/473] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:40 2022] GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:45:41.311333 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-630bb02e-bcb1-41ba-a89a-ce8600e7a4a9 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:41.312024 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-630bb02e-bcb1-41ba-a89a-ce8600e7a4a9 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: 54ec3019-6a8e-4080-a386-3894a165c7eb] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:41.318225 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-630bb02e-bcb1-41ba-a89a-ce8600e7a4a9 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:41.318678 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-630bb02e-bcb1-41ba-a89a-ce8600e7a4a9 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:41.320154 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-630bb02e-bcb1-41ba-a89a-ce8600e7a4a9 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:41.320541 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-630bb02e-bcb1-41ba-a89a-ce8600e7a4a9 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:41.457977 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-630bb02e-bcb1-41ba-a89a-ce8600e7a4a9 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:41.465880 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-630bb02e-bcb1-41ba-a89a-ce8600e7a4a9 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/54ec3019-6a8e-4080-a386-3894a165c7eb" status: 200 len: 1267 microversion: 2.1 time: 0.158717 May 23 15:45:41.466456 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 227/474] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:41 2022] GET /compute/v2.1/servers/54ec3019-6a8e-4080-a386-3894a165c7eb => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:45:42.040074 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-51bca7fa-ccf8-4170-91b1-511c76fa19c9 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:42.040689 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-51bca7fa-ccf8-4170-91b1-511c76fa19c9 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 15c3a3b9-3d55-44c3-8627-ba397c1f069d] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:42.046850 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-51bca7fa-ccf8-4170-91b1-511c76fa19c9 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:42.047330 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-51bca7fa-ccf8-4170-91b1-511c76fa19c9 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:42.048436 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-51bca7fa-ccf8-4170-91b1-511c76fa19c9 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:42.048934 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-51bca7fa-ccf8-4170-91b1-511c76fa19c9 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:42.175812 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-51bca7fa-ccf8-4170-91b1-511c76fa19c9 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:42.183607 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-51bca7fa-ccf8-4170-91b1-511c76fa19c9 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d" status: 200 len: 1732 microversion: 2.1 time: 0.148181 May 23 15:45:42.184163 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 248/475] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:42 2022] GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d => generated 1732 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:45:42.482973 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-1b44004f-1477-4554-a04c-9665bc9e3174 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:42.483509 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-1b44004f-1477-4554-a04c-9665bc9e3174 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: 54ec3019-6a8e-4080-a386-3894a165c7eb] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:42.490002 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1b44004f-1477-4554-a04c-9665bc9e3174 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:42.490444 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1b44004f-1477-4554-a04c-9665bc9e3174 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:42.491332 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1b44004f-1477-4554-a04c-9665bc9e3174 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:42.491763 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1b44004f-1477-4554-a04c-9665bc9e3174 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:42.495773 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:42.622939 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-1b44004f-1477-4554-a04c-9665bc9e3174 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:42.630288 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-1b44004f-1477-4554-a04c-9665bc9e3174 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/54ec3019-6a8e-4080-a386-3894a165c7eb" status: 200 len: 1267 microversion: 2.1 time: 0.151208 May 23 15:45:42.630851 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 228/476] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:42 2022] GET /compute/v2.1/servers/54ec3019-6a8e-4080-a386-3894a165c7eb => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:45:43.200722 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-597620b1-29ef-4906-8c6b-01f48567d4b8 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:43.201361 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-597620b1-29ef-4906-8c6b-01f48567d4b8 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 15c3a3b9-3d55-44c3-8627-ba397c1f069d] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:43.207380 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-597620b1-29ef-4906-8c6b-01f48567d4b8 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:43.207832 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-597620b1-29ef-4906-8c6b-01f48567d4b8 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:43.208595 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-597620b1-29ef-4906-8c6b-01f48567d4b8 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:43.209035 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-597620b1-29ef-4906-8c6b-01f48567d4b8 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:43.334982 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-597620b1-29ef-4906-8c6b-01f48567d4b8 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:43.343147 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-597620b1-29ef-4906-8c6b-01f48567d4b8 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d" status: 200 len: 1732 microversion: 2.1 time: 0.146314 May 23 15:45:43.343702 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 249/477] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:43 2022] GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d => generated 1732 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:45:43.647072 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-e415fc74-678f-4a33-adb8-141121e0c7ad tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:43.647691 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-e415fc74-678f-4a33-adb8-141121e0c7ad tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: 54ec3019-6a8e-4080-a386-3894a165c7eb] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:43.654743 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e415fc74-678f-4a33-adb8-141121e0c7ad tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:43.655195 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e415fc74-678f-4a33-adb8-141121e0c7ad tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:43.655959 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e415fc74-678f-4a33-adb8-141121e0c7ad tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:43.656396 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e415fc74-678f-4a33-adb8-141121e0c7ad tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:43.783986 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-e415fc74-678f-4a33-adb8-141121e0c7ad tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:43.791925 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-e415fc74-678f-4a33-adb8-141121e0c7ad tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/54ec3019-6a8e-4080-a386-3894a165c7eb" status: 200 len: 1267 microversion: 2.1 time: 0.148722 May 23 15:45:43.792487 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 229/478] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:43 2022] GET /compute/v2.1/servers/54ec3019-6a8e-4080-a386-3894a165c7eb => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:45:44.360482 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-c0f3b0d7-d313-4492-852a-987cc65a69f2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:44.361277 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-c0f3b0d7-d313-4492-852a-987cc65a69f2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 15c3a3b9-3d55-44c3-8627-ba397c1f069d] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:44.368941 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-c0f3b0d7-d313-4492-852a-987cc65a69f2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:44.369419 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-c0f3b0d7-d313-4492-852a-987cc65a69f2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:44.370266 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-c0f3b0d7-d313-4492-852a-987cc65a69f2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:44.370748 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-c0f3b0d7-d313-4492-852a-987cc65a69f2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:44.502163 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-c0f3b0d7-d313-4492-852a-987cc65a69f2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:44.510507 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-c0f3b0d7-d313-4492-852a-987cc65a69f2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d" status: 200 len: 1732 microversion: 2.1 time: 0.154251 May 23 15:45:44.511065 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 250/479] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:44 2022] GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:45:44.809813 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-94a4bd61-3f8e-4ac9-8294-8c59cdddbfe6 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:44.810432 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-94a4bd61-3f8e-4ac9-8294-8c59cdddbfe6 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: 54ec3019-6a8e-4080-a386-3894a165c7eb] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:44.816892 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-94a4bd61-3f8e-4ac9-8294-8c59cdddbfe6 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:44.817377 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-94a4bd61-3f8e-4ac9-8294-8c59cdddbfe6 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:44.818144 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-94a4bd61-3f8e-4ac9-8294-8c59cdddbfe6 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:44.818587 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-94a4bd61-3f8e-4ac9-8294-8c59cdddbfe6 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:44.947884 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-94a4bd61-3f8e-4ac9-8294-8c59cdddbfe6 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:44.955377 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-94a4bd61-3f8e-4ac9-8294-8c59cdddbfe6 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/54ec3019-6a8e-4080-a386-3894a165c7eb" status: 200 len: 1267 microversion: 2.1 time: 0.149455 May 23 15:45:44.955942 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 230/480] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:44 2022] GET /compute/v2.1/servers/54ec3019-6a8e-4080-a386-3894a165c7eb => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:45:45.528261 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-43420765-8a1e-4444-8249-d46d24e6b97f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:45.528779 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-43420765-8a1e-4444-8249-d46d24e6b97f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 15c3a3b9-3d55-44c3-8627-ba397c1f069d] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:45.534747 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-43420765-8a1e-4444-8249-d46d24e6b97f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:45.535191 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-43420765-8a1e-4444-8249-d46d24e6b97f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:45.535994 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-43420765-8a1e-4444-8249-d46d24e6b97f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:45.536423 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-43420765-8a1e-4444-8249-d46d24e6b97f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:45.670642 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-43420765-8a1e-4444-8249-d46d24e6b97f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:45.674554 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_cell1:SELECT=100 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:45.679396 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-43420765-8a1e-4444-8249-d46d24e6b97f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d" status: 200 len: 1732 microversion: 2.1 time: 0.155134 May 23 15:45:45.680066 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 251/481] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:45 2022] GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:45:45.972286 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-77ac7002-4d9c-4906-b295-e9a73ebd281c tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:45.972905 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-77ac7002-4d9c-4906-b295-e9a73ebd281c tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: 54ec3019-6a8e-4080-a386-3894a165c7eb] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:45.979993 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-77ac7002-4d9c-4906-b295-e9a73ebd281c tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:45.980453 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-77ac7002-4d9c-4906-b295-e9a73ebd281c tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:45.981295 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-77ac7002-4d9c-4906-b295-e9a73ebd281c tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:45.981733 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-77ac7002-4d9c-4906-b295-e9a73ebd281c tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:46.109677 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-77ac7002-4d9c-4906-b295-e9a73ebd281c tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:46.117528 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-77ac7002-4d9c-4906-b295-e9a73ebd281c tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/54ec3019-6a8e-4080-a386-3894a165c7eb" status: 200 len: 1267 microversion: 2.1 time: 0.148470 May 23 15:45:46.118364 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 231/482] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:45 2022] GET /compute/v2.1/servers/54ec3019-6a8e-4080-a386-3894a165c7eb => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:45:46.699882 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-4c9d4f64-838d-41fb-9472-e5d81c00c0bc tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:46.700343 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-4c9d4f64-838d-41fb-9472-e5d81c00c0bc tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 15c3a3b9-3d55-44c3-8627-ba397c1f069d] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:46.706618 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4c9d4f64-838d-41fb-9472-e5d81c00c0bc tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:46.707068 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4c9d4f64-838d-41fb-9472-e5d81c00c0bc tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:46.707829 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4c9d4f64-838d-41fb-9472-e5d81c00c0bc tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:46.708267 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4c9d4f64-838d-41fb-9472-e5d81c00c0bc tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:46.834856 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-4c9d4f64-838d-41fb-9472-e5d81c00c0bc tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:46.842766 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-4c9d4f64-838d-41fb-9472-e5d81c00c0bc tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d" status: 200 len: 1732 microversion: 2.1 time: 0.147965 May 23 15:45:46.843329 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 252/483] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:46 2022] GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d => generated 1732 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:45:47.133565 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-b2dc1b1d-3900-4158-aae6-64c62b6bebe0 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:47.134156 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-b2dc1b1d-3900-4158-aae6-64c62b6bebe0 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: 54ec3019-6a8e-4080-a386-3894a165c7eb] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:47.135988 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_cell0:SELECT=2 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:47.136657 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_cell0:SELECT=6 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:47.141940 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b2dc1b1d-3900-4158-aae6-64c62b6bebe0 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:47.147754 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b2dc1b1d-3900-4158-aae6-64c62b6bebe0 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:47.147754 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b2dc1b1d-3900-4158-aae6-64c62b6bebe0 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:47.147754 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b2dc1b1d-3900-4158-aae6-64c62b6bebe0 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:47.271766 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-b2dc1b1d-3900-4158-aae6-64c62b6bebe0 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:47.280057 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-b2dc1b1d-3900-4158-aae6-64c62b6bebe0 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/54ec3019-6a8e-4080-a386-3894a165c7eb" status: 200 len: 1267 microversion: 2.1 time: 0.150298 May 23 15:45:47.280593 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 232/484] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:47 2022] GET /compute/v2.1/servers/54ec3019-6a8e-4080-a386-3894a165c7eb => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:45:47.860272 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-65e51222-8c91-4bb9-b19e-ef8c70b14012 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:47.860890 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-65e51222-8c91-4bb9-b19e-ef8c70b14012 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 15c3a3b9-3d55-44c3-8627-ba397c1f069d] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:47.862761 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_cell0:SELECT=2 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:45:47.867691 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-65e51222-8c91-4bb9-b19e-ef8c70b14012 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:47.873574 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-65e51222-8c91-4bb9-b19e-ef8c70b14012 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:47.873574 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-65e51222-8c91-4bb9-b19e-ef8c70b14012 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:47.873574 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-65e51222-8c91-4bb9-b19e-ef8c70b14012 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:47.995889 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-65e51222-8c91-4bb9-b19e-ef8c70b14012 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:48.003614 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-65e51222-8c91-4bb9-b19e-ef8c70b14012 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d" status: 200 len: 1732 microversion: 2.1 time: 0.147220 May 23 15:45:48.004169 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 253/485] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:47 2022] GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d => generated 1732 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:45:48.297297 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-2745f49a-b483-4a6b-a5f4-de587d4128e2 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:48.298163 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-2745f49a-b483-4a6b-a5f4-de587d4128e2 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: 54ec3019-6a8e-4080-a386-3894a165c7eb] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:48.305372 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-2745f49a-b483-4a6b-a5f4-de587d4128e2 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:48.305822 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-2745f49a-b483-4a6b-a5f4-de587d4128e2 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:48.306617 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-2745f49a-b483-4a6b-a5f4-de587d4128e2 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:48.307082 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-2745f49a-b483-4a6b-a5f4-de587d4128e2 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:48.455440 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-2745f49a-b483-4a6b-a5f4-de587d4128e2 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:48.463102 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-2745f49a-b483-4a6b-a5f4-de587d4128e2 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/54ec3019-6a8e-4080-a386-3894a165c7eb" status: 200 len: 1267 microversion: 2.1 time: 0.169755 May 23 15:45:48.463850 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 233/486] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:48 2022] GET /compute/v2.1/servers/54ec3019-6a8e-4080-a386-3894a165c7eb => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:45:49.024305 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-5c1f824b-7834-45cf-a6f5-af78664047d6 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:49.024861 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-5c1f824b-7834-45cf-a6f5-af78664047d6 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 15c3a3b9-3d55-44c3-8627-ba397c1f069d] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:49.031126 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5c1f824b-7834-45cf-a6f5-af78664047d6 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:49.035650 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5c1f824b-7834-45cf-a6f5-af78664047d6 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:49.035650 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5c1f824b-7834-45cf-a6f5-af78664047d6 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:49.035650 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5c1f824b-7834-45cf-a6f5-af78664047d6 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:49.160400 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-5c1f824b-7834-45cf-a6f5-af78664047d6 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:49.168597 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-5c1f824b-7834-45cf-a6f5-af78664047d6 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d" status: 200 len: 1732 microversion: 2.1 time: 0.148771 May 23 15:45:49.169184 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 254/487] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:49 2022] GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d => generated 1732 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:45:49.479819 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-0f0ecd9d-33aa-4f1d-bd6a-e652badf9e3f tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:49.480407 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-0f0ecd9d-33aa-4f1d-bd6a-e652badf9e3f tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: 54ec3019-6a8e-4080-a386-3894a165c7eb] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:49.487035 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-0f0ecd9d-33aa-4f1d-bd6a-e652badf9e3f tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:49.487480 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-0f0ecd9d-33aa-4f1d-bd6a-e652badf9e3f tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:49.488235 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-0f0ecd9d-33aa-4f1d-bd6a-e652badf9e3f tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:49.488666 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-0f0ecd9d-33aa-4f1d-bd6a-e652badf9e3f tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:49.620120 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-0f0ecd9d-33aa-4f1d-bd6a-e652badf9e3f tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:49.627806 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-0f0ecd9d-33aa-4f1d-bd6a-e652badf9e3f tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/54ec3019-6a8e-4080-a386-3894a165c7eb" status: 200 len: 1267 microversion: 2.1 time: 0.151810 May 23 15:45:49.628666 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 234/488] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:49 2022] GET /compute/v2.1/servers/54ec3019-6a8e-4080-a386-3894a165c7eb => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:45:50.186211 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-2377d5f8-e487-4ef8-8949-f4c44b107ee7 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:50.186824 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-2377d5f8-e487-4ef8-8949-f4c44b107ee7 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 15c3a3b9-3d55-44c3-8627-ba397c1f069d] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:50.192750 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2377d5f8-e487-4ef8-8949-f4c44b107ee7 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:50.193291 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2377d5f8-e487-4ef8-8949-f4c44b107ee7 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:50.199884 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2377d5f8-e487-4ef8-8949-f4c44b107ee7 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:50.199884 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2377d5f8-e487-4ef8-8949-f4c44b107ee7 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:50.321385 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-2377d5f8-e487-4ef8-8949-f4c44b107ee7 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:50.329421 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-2377d5f8-e487-4ef8-8949-f4c44b107ee7 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d" status: 200 len: 1712 microversion: 2.1 time: 0.147095 May 23 15:45:50.334122 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 255/489] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:50 2022] GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d => generated 1712 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:45:50.432715 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-1f0fd9d0-da0c-4148-8c32-d1b76f5bc27c tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:50.433263 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-1f0fd9d0-da0c-4148-8c32-d1b76f5bc27c tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 15c3a3b9-3d55-44c3-8627-ba397c1f069d] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:50.439324 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1f0fd9d0-da0c-4148-8c32-d1b76f5bc27c tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:50.439723 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1f0fd9d0-da0c-4148-8c32-d1b76f5bc27c tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:50.440490 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1f0fd9d0-da0c-4148-8c32-d1b76f5bc27c tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:50.440929 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1f0fd9d0-da0c-4148-8c32-d1b76f5bc27c tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:50.518298 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.wsgi [None req-1f0fd9d0-da0c-4148-8c32-d1b76f5bc27c tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] HTTP exception thrown: Cannot 'detach_volume' instance 15c3a3b9-3d55-44c3-8627-ba397c1f069d while it is in vm_state rescued May 23 15:45:50.519906 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-1f0fd9d0-da0c-4148-8c32-d1b76f5bc27c tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Request method failure captured: May 23 15:45:50.519906 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: request: DELETE /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d/os-volume_attachments/7f22b416-6cbb-4e72-b5f9-e986120e2381 HTTP/1.1 May 23 15:45:50.519906 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Accept: application/json May 23 15:45:50.519906 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Accept-Encoding: identity May 23 15:45:50.519906 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Connection: close May 23 15:45:50.519906 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Content-Length: 0 May 23 15:45:50.519906 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Content-Type: application/json May 23 15:45:50.519906 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Host: 10.222.0.64 May 23 15:45:50.519906 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Openstack-System-Scope: None May 23 15:45:50.519906 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: User-Agent: python-urllib3/1.26.9 May 23 15:45:50.519906 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Auth-Token: gAAAAABii6s54KKAZxlQBYzhx-noNW6ImMu_qK18vzcxUodmAjvvJq-5TbaxZQIihTpeBFGJg_t4VXTJRBBdNp2S6NOFiVOcgKlGDwULP0bkoXn2Lrupumn987Hv9EwEHbef7k6ahcCsqTc5NRw34uO7WRPXXMvHMUWgqgfV68m8j7DAWMdthmk May 23 15:45:50.519906 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Domain-Id: None May 23 15:45:50.519906 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Domain-Name: None May 23 15:45:50.519906 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Identity-Status: Confirmed May 23 15:45:50.519906 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Is-Admin-Project: True May 23 15:45:50.519906 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Domain-Id: default May 23 15:45:50.519906 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Domain-Name: Default May 23 15:45:50.519906 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Id: 65483f2a0c914022b38e501691095c51 May 23 15:45:50.519906 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1263770255 May 23 15:45:50.519906 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Role: reader,member May 23 15:45:50.519906 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Roles: reader,member May 23 15:45:50.521570 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/65483f2a0c914022b38e501691095c51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/65483f2a0c914022b38e501691095c51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/65483f2a0c914022b38e501691095c51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_65483f2a0c914022b38e501691095c51", "adminURL": "http://10.222.0.64:8080"}]}] May 23 15:45:50.521570 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1263770255 May 23 15:45:50.521570 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant-Id: 65483f2a0c914022b38e501691095c51 May 23 15:45:50.521570 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1263770255 May 23 15:45:50.521570 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User: tempest-ServerRescueNegativeTestJSON-1263770255-project May 23 15:45:50.521570 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Domain-Id: default May 23 15:45:50.521570 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Domain-Name: Default May 23 15:45:50.521570 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Id: a2f1d435732b4ff0a60599309c66eeb5 May 23 15:45:50.521570 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1263770255-project May 23 15:45:50.521570 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: method: > May 23 15:45:50.521570 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: exception: Cannot 'detach_volume' instance 15c3a3b9-3d55-44c3-8627-ba397c1f069d while it is in vm_state rescued May 23 15:45:50.522446 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: action_args: {'server_id': '15c3a3b9-3d55-44c3-8627-ba397c1f069d', 'id': '7f22b416-6cbb-4e72-b5f9-e986120e2381'} May 23 15:45:50.522446 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:45:50.522446 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:45:50.522446 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 23 15:45:50.522446 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 23 15:45:50.522446 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 23 15:45:50.522446 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 15:45:50.522446 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 23 15:45:50.522446 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 23 15:45:50.522446 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 15c3a3b9-3d55-44c3-8627-ba397c1f069d in vm_state rescued. Cannot detach_volume while the instance is in this state. May 23 15:45:50.522446 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:45:50.522446 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:45:50.522446 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:45:50.522446 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:45:50.522446 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:45:50.522446 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:45:50.522446 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:45:50.522446 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:45:50.522446 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:45:50.522446 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:45:50.524709 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 23 15:45:50.524709 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 23 15:45:50.524709 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 23 15:45:50.524709 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 23 15:45:50.524709 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 15c3a3b9-3d55-44c3-8627-ba397c1f069d while it is in vm_state rescued May 23 15:45:50.524709 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:45:50.524709 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:45:50.524709 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:45:50.524709 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:45:50.524709 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:45:50.524709 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:45:50.524709 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:45:50.524709 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:45:50.524709 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 15c3a3b9-3d55-44c3-8627-ba397c1f069d while it is in vm_state rescued May 23 15:45:50.524709 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:45:50.524709 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-1f0fd9d0-da0c-4148-8c32-d1b76f5bc27c tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Returning 409 to user: Cannot 'detach_volume' instance 15c3a3b9-3d55-44c3-8627-ba397c1f069d while it is in vm_state rescued {{(pid=124933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:45:50.526266 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-1f0fd9d0-da0c-4148-8c32-d1b76f5bc27c tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "DELETE /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d/os-volume_attachments/7f22b416-6cbb-4e72-b5f9-e986120e2381" status: 409 len: 152 microversion: 2.1 time: 0.092614 May 23 15:45:50.526266 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 235/490] 10.222.0.64 () {58 vars in 1415 bytes} [Mon May 23 15:45:50 2022] DELETE /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d/os-volume_attachments/7f22b416-6cbb-4e72-b5f9-e986120e2381 => generated 152 bytes in 94 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 23 15:45:50.531362 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-9def3856-7a2b-45e0-94df-55772ff9a34a tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:45:50.531897 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-9def3856-7a2b-45e0-94df-55772ff9a34a tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 15c3a3b9-3d55-44c3-8627-ba397c1f069d] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:50.537824 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-9def3856-7a2b-45e0-94df-55772ff9a34a tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:50.538271 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-9def3856-7a2b-45e0-94df-55772ff9a34a tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:50.539693 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-9def3856-7a2b-45e0-94df-55772ff9a34a tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:50.540131 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-9def3856-7a2b-45e0-94df-55772ff9a34a tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:50.645435 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-e6d1953c-7414-4828-b50d-bc1a2cd88702 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:50.646064 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-e6d1953c-7414-4828-b50d-bc1a2cd88702 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: 54ec3019-6a8e-4080-a386-3894a165c7eb] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:50.652750 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e6d1953c-7414-4828-b50d-bc1a2cd88702 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:50.653228 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e6d1953c-7414-4828-b50d-bc1a2cd88702 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:50.653983 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e6d1953c-7414-4828-b50d-bc1a2cd88702 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:50.654417 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e6d1953c-7414-4828-b50d-bc1a2cd88702 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:50.777186 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-9def3856-7a2b-45e0-94df-55772ff9a34a tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "POST /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d/action" status: 202 len: 0 microversion: 2.1 time: 0.249394 May 23 15:45:50.780690 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 256/491] 10.222.0.64 () {60 vars in 1277 bytes} [Mon May 23 15:45:50 2022] POST /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 15:45:50.785414 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-e6d1953c-7414-4828-b50d-bc1a2cd88702 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:50.790582 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-4bee8443-a174-4ea8-baa9-9a53713dc792 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:50.790582 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-4bee8443-a174-4ea8-baa9-9a53713dc792 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 15c3a3b9-3d55-44c3-8627-ba397c1f069d] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:50.794263 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-e6d1953c-7414-4828-b50d-bc1a2cd88702 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/54ec3019-6a8e-4080-a386-3894a165c7eb" status: 200 len: 1267 microversion: 2.1 time: 0.152479 May 23 15:45:50.794427 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4bee8443-a174-4ea8-baa9-9a53713dc792 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:50.794744 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4bee8443-a174-4ea8-baa9-9a53713dc792 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:50.794963 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 236/492] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:50 2022] GET /compute/v2.1/servers/54ec3019-6a8e-4080-a386-3894a165c7eb => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:45:50.795522 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4bee8443-a174-4ea8-baa9-9a53713dc792 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:50.795958 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4bee8443-a174-4ea8-baa9-9a53713dc792 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:50.933480 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-4bee8443-a174-4ea8-baa9-9a53713dc792 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:50.942160 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-4bee8443-a174-4ea8-baa9-9a53713dc792 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d" status: 200 len: 1720 microversion: 2.1 time: 0.159930 May 23 15:45:50.942936 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 257/493] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:50 2022] GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:45:51.811929 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-641b0ca6-54bc-415f-9129-3a1e3e4f926c tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:51.812639 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-641b0ca6-54bc-415f-9129-3a1e3e4f926c tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: 54ec3019-6a8e-4080-a386-3894a165c7eb] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:51.819058 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-641b0ca6-54bc-415f-9129-3a1e3e4f926c tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:51.819515 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-641b0ca6-54bc-415f-9129-3a1e3e4f926c tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:51.820277 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-641b0ca6-54bc-415f-9129-3a1e3e4f926c tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:51.821427 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-641b0ca6-54bc-415f-9129-3a1e3e4f926c tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:51.952510 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-641b0ca6-54bc-415f-9129-3a1e3e4f926c tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:51.959712 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-57c579c1-b5f0-4b18-8a3b-cea30fc6958c tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:51.960225 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-641b0ca6-54bc-415f-9129-3a1e3e4f926c tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/54ec3019-6a8e-4080-a386-3894a165c7eb" status: 200 len: 1267 microversion: 2.1 time: 0.151958 May 23 15:45:51.960361 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-57c579c1-b5f0-4b18-8a3b-cea30fc6958c tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 15c3a3b9-3d55-44c3-8627-ba397c1f069d] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:51.960617 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 237/494] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:51 2022] GET /compute/v2.1/servers/54ec3019-6a8e-4080-a386-3894a165c7eb => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:45:51.967156 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-57c579c1-b5f0-4b18-8a3b-cea30fc6958c tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:51.967606 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-57c579c1-b5f0-4b18-8a3b-cea30fc6958c tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:51.968374 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-57c579c1-b5f0-4b18-8a3b-cea30fc6958c tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:51.968811 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-57c579c1-b5f0-4b18-8a3b-cea30fc6958c tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:52.108956 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-57c579c1-b5f0-4b18-8a3b-cea30fc6958c tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:52.116788 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-57c579c1-b5f0-4b18-8a3b-cea30fc6958c tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d" status: 200 len: 1720 microversion: 2.1 time: 0.160925 May 23 15:45:52.117382 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 258/495] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:51 2022] GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:45:52.976996 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-51e79016-0a0a-4fe6-b620-14f20261ca61 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:52.977773 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-51e79016-0a0a-4fe6-b620-14f20261ca61 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: 54ec3019-6a8e-4080-a386-3894a165c7eb] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:52.984250 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-51e79016-0a0a-4fe6-b620-14f20261ca61 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:52.984636 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-51e79016-0a0a-4fe6-b620-14f20261ca61 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:52.985443 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-51e79016-0a0a-4fe6-b620-14f20261ca61 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:52.985886 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-51e79016-0a0a-4fe6-b620-14f20261ca61 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:53.036597 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [req-ca238bea-bca0-44b8-8876-535c8fc8b3c9 req-5cbee32b-4efd-4286-90a3-6c195ef36c43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54ec3019-6a8e-4080-a386-3894a165c7eb", "name": "network-vif-plugged", "status": "completed", "tag": "9998b808-7746-404c-a44c-c2b50e15e918"}]} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:45:53.045418 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-ca238bea-bca0-44b8-8876-535c8fc8b3c9 req-5cbee32b-4efd-4286-90a3-6c195ef36c43 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:53.045764 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-ca238bea-bca0-44b8-8876-535c8fc8b3c9 req-5cbee32b-4efd-4286-90a3-6c195ef36c43 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:53.057220 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.compute.server_external_events [req-ca238bea-bca0-44b8-8876-535c8fc8b3c9 req-5cbee32b-4efd-4286-90a3-6c195ef36c43 service nova] Creating event network-vif-plugged:9998b808-7746-404c-a44c-c2b50e15e918 for instance 54ec3019-6a8e-4080-a386-3894a165c7eb on hv-cinder-84067 May 23 15:45:53.062037 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [req-ca238bea-bca0-44b8-8876-535c8fc8b3c9 req-5cbee32b-4efd-4286-90a3-6c195ef36c43 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029129 May 23 15:45:53.062938 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 259/496] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:45:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:45:53.119991 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-51e79016-0a0a-4fe6-b620-14f20261ca61 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:53.127528 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-51e79016-0a0a-4fe6-b620-14f20261ca61 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/54ec3019-6a8e-4080-a386-3894a165c7eb" status: 200 len: 1267 microversion: 2.1 time: 0.154579 May 23 15:45:53.128394 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 238/497] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:52 2022] GET /compute/v2.1/servers/54ec3019-6a8e-4080-a386-3894a165c7eb => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:45:53.136089 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-2d014ce9-f5aa-4965-bad6-71794ff23933 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:53.136787 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-2d014ce9-f5aa-4965-bad6-71794ff23933 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 15c3a3b9-3d55-44c3-8627-ba397c1f069d] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:53.143359 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2d014ce9-f5aa-4965-bad6-71794ff23933 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:53.143812 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2d014ce9-f5aa-4965-bad6-71794ff23933 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:53.144583 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2d014ce9-f5aa-4965-bad6-71794ff23933 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:53.145017 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2d014ce9-f5aa-4965-bad6-71794ff23933 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:53.283527 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-2d014ce9-f5aa-4965-bad6-71794ff23933 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:53.291877 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-2d014ce9-f5aa-4965-bad6-71794ff23933 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d" status: 200 len: 1720 microversion: 2.1 time: 0.160568 May 23 15:45:53.292431 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 260/498] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:53 2022] GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:45:54.144204 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-8ecef8e3-c9de-4f53-87cc-f59e68217d5c tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:54.144817 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-8ecef8e3-c9de-4f53-87cc-f59e68217d5c tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: 54ec3019-6a8e-4080-a386-3894a165c7eb] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:54.152551 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-8ecef8e3-c9de-4f53-87cc-f59e68217d5c tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:54.153003 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-8ecef8e3-c9de-4f53-87cc-f59e68217d5c tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:54.153792 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-8ecef8e3-c9de-4f53-87cc-f59e68217d5c tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:54.154232 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-8ecef8e3-c9de-4f53-87cc-f59e68217d5c tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:54.289045 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-8ecef8e3-c9de-4f53-87cc-f59e68217d5c tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:54.297315 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-8ecef8e3-c9de-4f53-87cc-f59e68217d5c tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/54ec3019-6a8e-4080-a386-3894a165c7eb" status: 200 len: 1267 microversion: 2.1 time: 0.156923 May 23 15:45:54.298978 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 239/499] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:54 2022] GET /compute/v2.1/servers/54ec3019-6a8e-4080-a386-3894a165c7eb => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:45:54.309697 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-2fe5f3a5-2af9-4622-a125-cf04ee0252e0 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:54.310352 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-2fe5f3a5-2af9-4622-a125-cf04ee0252e0 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 15c3a3b9-3d55-44c3-8627-ba397c1f069d] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:54.316253 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2fe5f3a5-2af9-4622-a125-cf04ee0252e0 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:54.316706 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2fe5f3a5-2af9-4622-a125-cf04ee0252e0 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:54.317519 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2fe5f3a5-2af9-4622-a125-cf04ee0252e0 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:54.317964 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2fe5f3a5-2af9-4622-a125-cf04ee0252e0 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:54.448115 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-2fe5f3a5-2af9-4622-a125-cf04ee0252e0 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:54.455948 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-2fe5f3a5-2af9-4622-a125-cf04ee0252e0 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d" status: 200 len: 1726 microversion: 2.1 time: 0.151015 May 23 15:45:54.456505 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 261/500] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:54 2022] GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:45:54.472134 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-8c36fd48-9108-462e-bdfb-ba2b7a590bf2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:54.472628 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-8c36fd48-9108-462e-bdfb-ba2b7a590bf2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 15c3a3b9-3d55-44c3-8627-ba397c1f069d] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:54.479010 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-8c36fd48-9108-462e-bdfb-ba2b7a590bf2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:54.479452 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-8c36fd48-9108-462e-bdfb-ba2b7a590bf2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:54.480261 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-8c36fd48-9108-462e-bdfb-ba2b7a590bf2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:54.480697 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-8c36fd48-9108-462e-bdfb-ba2b7a590bf2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:54.561023 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-8c36fd48-9108-462e-bdfb-ba2b7a590bf2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092611 May 23 15:45:54.561654 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 240/501] 10.222.0.64 () {58 vars in 1274 bytes} [Mon May 23 15:45:54 2022] GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:45:55.314960 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-aea5a8f1-0f09-41c3-a872-6df7ba86ede9 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:55.315573 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-aea5a8f1-0f09-41c3-a872-6df7ba86ede9 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: 54ec3019-6a8e-4080-a386-3894a165c7eb] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:55.322164 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-aea5a8f1-0f09-41c3-a872-6df7ba86ede9 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:55.322692 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-aea5a8f1-0f09-41c3-a872-6df7ba86ede9 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:55.323539 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-aea5a8f1-0f09-41c3-a872-6df7ba86ede9 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:55.324085 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-aea5a8f1-0f09-41c3-a872-6df7ba86ede9 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:55.755819 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [req-472a9691-25af-4cff-ad54-708b26a43b56 req-164d76a9-92eb-4baa-a83e-0dedfcde4e8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15c3a3b9-3d55-44c3-8627-ba397c1f069d", "tag": "f835d7e4-2023-42a3-91c1-27e29436c365"}]} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:45:55.764466 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-472a9691-25af-4cff-ad54-708b26a43b56 req-164d76a9-92eb-4baa-a83e-0dedfcde4e8d service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:55.764943 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-472a9691-25af-4cff-ad54-708b26a43b56 req-164d76a9-92eb-4baa-a83e-0dedfcde4e8d service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:55.780540 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-aea5a8f1-0f09-41c3-a872-6df7ba86ede9 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:55.785621 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.compute.server_external_events [req-472a9691-25af-4cff-ad54-708b26a43b56 req-164d76a9-92eb-4baa-a83e-0dedfcde4e8d service nova] Creating event network-changed:f835d7e4-2023-42a3-91c1-27e29436c365 for instance 15c3a3b9-3d55-44c3-8627-ba397c1f069d on hv-cinder-84067 May 23 15:45:55.788189 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-aea5a8f1-0f09-41c3-a872-6df7ba86ede9 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/54ec3019-6a8e-4080-a386-3894a165c7eb" status: 200 len: 1267 microversion: 2.1 time: 0.476027 May 23 15:45:55.788189 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 262/502] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:55 2022] GET /compute/v2.1/servers/54ec3019-6a8e-4080-a386-3894a165c7eb => generated 1267 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:45:55.791723 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [req-472a9691-25af-4cff-ad54-708b26a43b56 req-164d76a9-92eb-4baa-a83e-0dedfcde4e8d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040220 May 23 15:45:55.792470 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 241/503] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:45:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:45:56.806257 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-1da8cd39-c7cf-4ce9-8b7b-aa5e9c6c04de tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:56.806876 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-1da8cd39-c7cf-4ce9-8b7b-aa5e9c6c04de tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: 54ec3019-6a8e-4080-a386-3894a165c7eb] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:56.812943 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-1da8cd39-c7cf-4ce9-8b7b-aa5e9c6c04de tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:56.813452 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-1da8cd39-c7cf-4ce9-8b7b-aa5e9c6c04de tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:56.814221 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-1da8cd39-c7cf-4ce9-8b7b-aa5e9c6c04de tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:56.814664 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-1da8cd39-c7cf-4ce9-8b7b-aa5e9c6c04de tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:56.946599 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-1da8cd39-c7cf-4ce9-8b7b-aa5e9c6c04de tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:56.954127 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-1da8cd39-c7cf-4ce9-8b7b-aa5e9c6c04de tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/54ec3019-6a8e-4080-a386-3894a165c7eb" status: 200 len: 1454 microversion: 2.1 time: 0.152851 May 23 15:45:56.954683 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 263/504] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:56 2022] GET /compute/v2.1/servers/54ec3019-6a8e-4080-a386-3894a165c7eb => generated 1454 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:45:56.971760 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-2fa3cfe5-7262-4312-9027-724f3487ecdd tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:45:56.972465 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-2fa3cfe5-7262-4312-9027-724f3487ecdd tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: 54ec3019-6a8e-4080-a386-3894a165c7eb] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:45:56.979716 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-2fa3cfe5-7262-4312-9027-724f3487ecdd tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:56.980169 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-2fa3cfe5-7262-4312-9027-724f3487ecdd tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:56.980926 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-2fa3cfe5-7262-4312-9027-724f3487ecdd tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:56.981394 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-2fa3cfe5-7262-4312-9027-724f3487ecdd tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:57.113425 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-2fa3cfe5-7262-4312-9027-724f3487ecdd tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:45:57.120992 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-2fa3cfe5-7262-4312-9027-724f3487ecdd tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/54ec3019-6a8e-4080-a386-3894a165c7eb" status: 200 len: 1454 microversion: 2.1 time: 0.153850 May 23 15:45:57.121794 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 242/505] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:45:56 2022] GET /compute/v2.1/servers/54ec3019-6a8e-4080-a386-3894a165c7eb => generated 1454 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:45:57.818447 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [req-546f6533-a6dc-443a-aba1-c84da01eb9fc req-23694202-3d2b-4a0e-b8cc-9b0f775d8ee8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15c3a3b9-3d55-44c3-8627-ba397c1f069d", "tag": "f835d7e4-2023-42a3-91c1-27e29436c365"}]} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:45:57.827610 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-546f6533-a6dc-443a-aba1-c84da01eb9fc req-23694202-3d2b-4a0e-b8cc-9b0f775d8ee8 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:57.828054 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-546f6533-a6dc-443a-aba1-c84da01eb9fc req-23694202-3d2b-4a0e-b8cc-9b0f775d8ee8 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:57.840181 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.compute.server_external_events [req-546f6533-a6dc-443a-aba1-c84da01eb9fc req-23694202-3d2b-4a0e-b8cc-9b0f775d8ee8 service nova] Creating event network-changed:f835d7e4-2023-42a3-91c1-27e29436c365 for instance 15c3a3b9-3d55-44c3-8627-ba397c1f069d on hv-cinder-84067 May 23 15:45:57.845233 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [req-546f6533-a6dc-443a-aba1-c84da01eb9fc req-23694202-3d2b-4a0e-b8cc-9b0f775d8ee8 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030444 May 23 15:45:57.845822 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 264/506] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:45:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:45:59.864160 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [req-ab54a906-4e25-4bd8-ad75-b8e323601813 req-bbbca45e-a0a5-4f82-ab3b-6e7e2dda724f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54ec3019-6a8e-4080-a386-3894a165c7eb", "tag": "9998b808-7746-404c-a44c-c2b50e15e918"}]} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:45:59.873291 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-ab54a906-4e25-4bd8-ad75-b8e323601813 req-bbbca45e-a0a5-4f82-ab3b-6e7e2dda724f service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:45:59.873745 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-ab54a906-4e25-4bd8-ad75-b8e323601813 req-bbbca45e-a0a5-4f82-ab3b-6e7e2dda724f service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:45:59.884617 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.compute.server_external_events [req-ab54a906-4e25-4bd8-ad75-b8e323601813 req-bbbca45e-a0a5-4f82-ab3b-6e7e2dda724f service nova] Creating event network-changed:9998b808-7746-404c-a44c-c2b50e15e918 for instance 54ec3019-6a8e-4080-a386-3894a165c7eb on hv-cinder-84067 May 23 15:45:59.889605 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [req-ab54a906-4e25-4bd8-ad75-b8e323601813 req-bbbca45e-a0a5-4f82-ab3b-6e7e2dda724f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028989 May 23 15:45:59.890214 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 243/507] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:45:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:46:13.299413 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_api:SELECT=51 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:13.300154 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:13.304158 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-e13f7fc3-5040-40ef-9ef0-a968a7c62a5a tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:13.304730 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-e13f7fc3-5040-40ef-9ef0-a968a7c62a5a tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: aafabce5-30ac-488a-9d85-2d453337bf71] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:13.311404 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e13f7fc3-5040-40ef-9ef0-a968a7c62a5a tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:13.311849 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e13f7fc3-5040-40ef-9ef0-a968a7c62a5a tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:13.312735 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e13f7fc3-5040-40ef-9ef0-a968a7c62a5a tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:13.313023 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e13f7fc3-5040-40ef-9ef0-a968a7c62a5a tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:13.335794 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-e13f7fc3-5040-40ef-9ef0-a968a7c62a5a tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/aafabce5-30ac-488a-9d85-2d453337bf71/ips" status: 200 len: 150 microversion: 2.1 time: 0.037858 May 23 15:46:13.336355 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 265/508] 10.222.0.64 () {58 vars in 1247 bytes} [Mon May 23 15:46:13 2022] GET /compute/v2.1/servers/aafabce5-30ac-488a-9d85-2d453337bf71/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:46:13.345345 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:13.346089 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_cell1:SELECT=84 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:13.350449 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-5dfec63e-b68a-42d8-b635-fb251364b0ae tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8f0ad502-a7fc-4cd6-803d-e41ae63f7048"}} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:46:13.351584 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-5dfec63e-b68a-42d8-b635-fb251364b0ae tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: aafabce5-30ac-488a-9d85-2d453337bf71] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:13.358320 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-5dfec63e-b68a-42d8-b635-fb251364b0ae tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:13.358810 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-5dfec63e-b68a-42d8-b635-fb251364b0ae tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:13.359600 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-5dfec63e-b68a-42d8-b635-fb251364b0ae tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:13.360037 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-5dfec63e-b68a-42d8-b635-fb251364b0ae tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:13.439607 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.wsgi [None req-5dfec63e-b68a-42d8-b635-fb251364b0ae tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] HTTP exception thrown: Invalid volume: volume 8f0ad502-a7fc-4cd6-803d-e41ae63f7048 is already attached to instances: ce2cd056-b2f1-43fb-a60a-323039d15162 May 23 15:46:13.441393 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-5dfec63e-b68a-42d8-b635-fb251364b0ae tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Request method failure captured: May 23 15:46:13.441393 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: request: POST /compute/v2.1/servers/aafabce5-30ac-488a-9d85-2d453337bf71/os-volume_attachments HTTP/1.1 May 23 15:46:13.441393 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Accept: application/json May 23 15:46:13.441393 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Accept-Encoding: identity May 23 15:46:13.441393 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Connection: close May 23 15:46:13.441393 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Content-Length: 74 May 23 15:46:13.441393 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Content-Type: application/json May 23 15:46:13.441393 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Host: 10.222.0.64 May 23 15:46:13.441393 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Openstack-System-Scope: None May 23 15:46:13.441393 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: User-Agent: python-urllib3/1.26.9 May 23 15:46:13.441393 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Auth-Token: gAAAAABii6uOGntB7Pc55mvjpSIsPzNLOlywCYGbr_-Vzy5_quOX_mjNj5PwEdU1U5x_QaGgk51iZzj3S4TZVzOIWCHWkRILSGjcG5ZDd1N2DadGTyYCWvrZ0p61UD6zAV5lw6yOUFVzzVm3KSoYQSF_ZlPFocwbQbQqnGoN6Tr34TmSqfoSNW8 May 23 15:46:13.441393 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Domain-Id: None May 23 15:46:13.441393 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Domain-Name: None May 23 15:46:13.441393 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Identity-Status: Confirmed May 23 15:46:13.441393 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Is-Admin-Project: True May 23 15:46:13.441393 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Domain-Id: default May 23 15:46:13.441393 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Domain-Name: Default May 23 15:46:13.441393 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Id: a15ae9d15a64468f80628ed51c2e42d6 May 23 15:46:13.441393 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Name: tempest-AttachVolumeNegativeTest-2009285566 May 23 15:46:13.441393 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Role: reader,member May 23 15:46:13.441393 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Roles: reader,member May 23 15:46:13.448930 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a15ae9d15a64468f80628ed51c2e42d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a15ae9d15a64468f80628ed51c2e42d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a15ae9d15a64468f80628ed51c2e42d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a15ae9d15a64468f80628ed51c2e42d6", "adminURL": "http://10.222.0.64:8080"}]}] May 23 15:46:13.448930 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant: tempest-AttachVolumeNegativeTest-2009285566 May 23 15:46:13.448930 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant-Id: a15ae9d15a64468f80628ed51c2e42d6 May 23 15:46:13.448930 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2009285566 May 23 15:46:13.448930 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User: tempest-AttachVolumeNegativeTest-2009285566-project May 23 15:46:13.448930 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Domain-Id: default May 23 15:46:13.448930 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Domain-Name: Default May 23 15:46:13.448930 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Id: 472049224bbf48699b8a9410ec61aa9e May 23 15:46:13.448930 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Name: tempest-AttachVolumeNegativeTest-2009285566-project May 23 15:46:13.448930 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: May 23 15:46:13.448930 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: {"volumeAttachment": {"volumeId": "8f0ad502-a7fc-4cd6-803d-e41ae63f7048"}} May 23 15:46:13.448930 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: method: > May 23 15:46:13.449800 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: exception: Invalid volume: volume 8f0ad502-a7fc-4cd6-803d-e41ae63f7048 is already attached to instances: ce2cd056-b2f1-43fb-a60a-323039d15162 May 23 15:46:13.449800 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: action_args: {'server_id': 'aafabce5-30ac-488a-9d85-2d453337bf71', 'body': {'volumeAttachment': {'volumeId': '8f0ad502-a7fc-4cd6-803d-e41ae63f7048'}}} May 23 15:46:13.449800 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:46:13.449800 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:46:13.449800 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 23 15:46:13.449800 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 23 15:46:13.449800 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 23 15:46:13.449800 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 15:46:13.449800 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 23 15:46:13.449800 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 23 15:46:13.449800 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 23 15:46:13.449800 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 23 15:46:13.449800 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 23 15:46:13.449800 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 23 15:46:13.449800 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 8f0ad502-a7fc-4cd6-803d-e41ae63f7048 is already attached to instances: ce2cd056-b2f1-43fb-a60a-323039d15162 May 23 15:46:13.449800 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:46:13.449800 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:46:13.449800 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:46:13.449800 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:46:13.451193 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:46:13.451193 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:46:13.451193 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:46:13.451193 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:46:13.451193 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:46:13.451193 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:46:13.451193 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 15:46:13.451193 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 15:46:13.451193 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 15:46:13.451193 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 15:46:13.451193 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 15:46:13.451193 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 15:46:13.451193 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 23 15:46:13.451193 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 23 15:46:13.451193 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 8f0ad502-a7fc-4cd6-803d-e41ae63f7048 is already attached to instances: ce2cd056-b2f1-43fb-a60a-323039d15162 May 23 15:46:13.451193 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:46:13.451193 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:46:13.451193 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:46:13.451193 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:46:13.451193 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:46:13.452416 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:46:13.452416 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:46:13.452416 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:46:13.452416 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 8f0ad502-a7fc-4cd6-803d-e41ae63f7048 is already attached to instances: ce2cd056-b2f1-43fb-a60a-323039d15162 May 23 15:46:13.452416 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:46:13.452416 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-5dfec63e-b68a-42d8-b635-fb251364b0ae tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Returning 400 to user: Invalid volume: volume 8f0ad502-a7fc-4cd6-803d-e41ae63f7048 is already attached to instances: ce2cd056-b2f1-43fb-a60a-323039d15162 {{(pid=124933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:46:13.452416 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-5dfec63e-b68a-42d8-b635-fb251364b0ae tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "POST /compute/v2.1/servers/aafabce5-30ac-488a-9d85-2d453337bf71/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099168 May 23 15:46:13.452416 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 244/509] 10.222.0.64 () {60 vars in 1322 bytes} [Mon May 23 15:46:13 2022] POST /compute/v2.1/servers/aafabce5-30ac-488a-9d85-2d453337bf71/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 23 15:46:13.453022 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-e81b3369-1e27-41de-8841-b0e007fef196 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:13.453022 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-e81b3369-1e27-41de-8841-b0e007fef196 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: aafabce5-30ac-488a-9d85-2d453337bf71] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:13.458851 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e81b3369-1e27-41de-8841-b0e007fef196 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:13.459301 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e81b3369-1e27-41de-8841-b0e007fef196 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:13.460056 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e81b3369-1e27-41de-8841-b0e007fef196 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:13.460491 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e81b3369-1e27-41de-8841-b0e007fef196 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:13.489275 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-e81b3369-1e27-41de-8841-b0e007fef196 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: aafabce5-30ac-488a-9d85-2d453337bf71] Going to try to terminate instance {{(pid=124934) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 15:46:13.716940 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-e81b3369-1e27-41de-8841-b0e007fef196 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "DELETE /compute/v2.1/servers/aafabce5-30ac-488a-9d85-2d453337bf71" status: 204 len: 0 microversion: 2.1 time: 0.268046 May 23 15:46:13.726300 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 266/510] 10.222.0.64 () {58 vars in 1238 bytes} [Mon May 23 15:46:13 2022] DELETE /compute/v2.1/servers/aafabce5-30ac-488a-9d85-2d453337bf71 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 23 15:46:13.726424 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-6fe11870-1caa-4102-a8aa-ba1fbd1bf40a tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:13.726609 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-6fe11870-1caa-4102-a8aa-ba1fbd1bf40a tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: aafabce5-30ac-488a-9d85-2d453337bf71] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:13.732904 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-6fe11870-1caa-4102-a8aa-ba1fbd1bf40a tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:13.733390 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-6fe11870-1caa-4102-a8aa-ba1fbd1bf40a tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:13.734168 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-6fe11870-1caa-4102-a8aa-ba1fbd1bf40a tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:13.734613 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-6fe11870-1caa-4102-a8aa-ba1fbd1bf40a tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:13.866048 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-6fe11870-1caa-4102-a8aa-ba1fbd1bf40a tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:46:13.873546 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-6fe11870-1caa-4102-a8aa-ba1fbd1bf40a tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/aafabce5-30ac-488a-9d85-2d453337bf71" status: 200 len: 1681 microversion: 2.1 time: 0.151313 May 23 15:46:13.874107 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 245/511] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:13 2022] GET /compute/v2.1/servers/aafabce5-30ac-488a-9d85-2d453337bf71 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:46:14.413271 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-086123b9-2f76-4954-8e8d-668adc1a1f2e tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:14.414312 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-086123b9-2f76-4954-8e8d-668adc1a1f2e tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:14.420903 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-086123b9-2f76-4954-8e8d-668adc1a1f2e tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:14.421385 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-086123b9-2f76-4954-8e8d-668adc1a1f2e tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:14.422143 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-086123b9-2f76-4954-8e8d-668adc1a1f2e tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:14.422622 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-086123b9-2f76-4954-8e8d-668adc1a1f2e tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:14.450622 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-086123b9-2f76-4954-8e8d-668adc1a1f2e tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040932 May 23 15:46:14.451205 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 267/512] 10.222.0.64 () {58 vars in 1301 bytes} [Mon May 23 15:46:14 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 15:46:14.507658 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-c73d5d42-8254-4336-8a5d-ed470ea37e0a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:14.508162 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-c73d5d42-8254-4336-8a5d-ed470ea37e0a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:14.515261 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c73d5d42-8254-4336-8a5d-ed470ea37e0a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:14.515718 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c73d5d42-8254-4336-8a5d-ed470ea37e0a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:14.516491 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c73d5d42-8254-4336-8a5d-ed470ea37e0a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:14.516935 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c73d5d42-8254-4336-8a5d-ed470ea37e0a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:14.541795 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-c73d5d42-8254-4336-8a5d-ed470ea37e0a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Going to try to terminate instance {{(pid=124933) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 15:46:14.859214 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-c73d5d42-8254-4336-8a5d-ed470ea37e0a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "DELETE /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 204 len: 0 microversion: 2.1 time: 0.355353 May 23 15:46:14.859816 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 246/513] 10.222.0.64 () {58 vars in 1238 bytes} [Mon May 23 15:46:14 2022] DELETE /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 15:46:14.868259 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-724a7b07-18d5-468a-bc06-792c8074b690 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:14.868863 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-724a7b07-18d5-468a-bc06-792c8074b690 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:14.876193 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-724a7b07-18d5-468a-bc06-792c8074b690 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:14.876641 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-724a7b07-18d5-468a-bc06-792c8074b690 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:14.877558 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-724a7b07-18d5-468a-bc06-792c8074b690 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:14.877995 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-724a7b07-18d5-468a-bc06-792c8074b690 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:14.895917 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-d3ebe14c-d2a1-4e77-bd0e-28b8cc1c9588 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:14.897604 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-d3ebe14c-d2a1-4e77-bd0e-28b8cc1c9588 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: aafabce5-30ac-488a-9d85-2d453337bf71] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:14.904894 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-d3ebe14c-d2a1-4e77-bd0e-28b8cc1c9588 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:14.905438 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-d3ebe14c-d2a1-4e77-bd0e-28b8cc1c9588 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:14.906314 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-d3ebe14c-d2a1-4e77-bd0e-28b8cc1c9588 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:14.907078 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-d3ebe14c-d2a1-4e77-bd0e-28b8cc1c9588 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:15.126888 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-724a7b07-18d5-468a-bc06-792c8074b690 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:46:15.131745 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-d3ebe14c-d2a1-4e77-bd0e-28b8cc1c9588 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:46:15.134391 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-724a7b07-18d5-468a-bc06-792c8074b690 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 200 len: 1672 microversion: 2.1 time: 0.270080 May 23 15:46:15.135047 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 268/514] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:14 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 1672 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:46:15.144605 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-d3ebe14c-d2a1-4e77-bd0e-28b8cc1c9588 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/aafabce5-30ac-488a-9d85-2d453337bf71" status: 200 len: 1681 microversion: 2.1 time: 0.252986 May 23 15:46:15.145196 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 247/515] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:14 2022] GET /compute/v2.1/servers/aafabce5-30ac-488a-9d85-2d453337bf71 => generated 1681 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:46:16.155925 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-91dd08ac-9e2b-4724-9280-6be2a896fed2 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:16.156704 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-91dd08ac-9e2b-4724-9280-6be2a896fed2 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:16.162819 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-2ab5d11f-8626-4eb3-8ae8-a95d60395ead tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:16.163285 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-91dd08ac-9e2b-4724-9280-6be2a896fed2 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:16.163285 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-91dd08ac-9e2b-4724-9280-6be2a896fed2 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:16.163496 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-2ab5d11f-8626-4eb3-8ae8-a95d60395ead tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: aafabce5-30ac-488a-9d85-2d453337bf71] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:16.164054 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-91dd08ac-9e2b-4724-9280-6be2a896fed2 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:16.164522 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-91dd08ac-9e2b-4724-9280-6be2a896fed2 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:16.169762 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-2ab5d11f-8626-4eb3-8ae8-a95d60395ead tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:16.170204 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-2ab5d11f-8626-4eb3-8ae8-a95d60395ead tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:16.170961 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-2ab5d11f-8626-4eb3-8ae8-a95d60395ead tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:16.171393 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-2ab5d11f-8626-4eb3-8ae8-a95d60395ead tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:16.360008 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-91dd08ac-9e2b-4724-9280-6be2a896fed2 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:46:16.363618 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-2ab5d11f-8626-4eb3-8ae8-a95d60395ead tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:46:16.369108 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-91dd08ac-9e2b-4724-9280-6be2a896fed2 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 200 len: 1672 microversion: 2.1 time: 0.217759 May 23 15:46:16.369696 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 269/516] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:16 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 1672 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:46:16.371273 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-2ab5d11f-8626-4eb3-8ae8-a95d60395ead tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/aafabce5-30ac-488a-9d85-2d453337bf71" status: 200 len: 1681 microversion: 2.1 time: 0.212216 May 23 15:46:16.372473 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 248/517] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:16 2022] GET /compute/v2.1/servers/aafabce5-30ac-488a-9d85-2d453337bf71 => generated 1681 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:46:17.387521 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-3dda28d3-80a0-4fac-88b5-34eab6352a40 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:17.388212 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-3dda28d3-80a0-4fac-88b5-34eab6352a40 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:17.390173 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-27fd7227-ac24-476a-8334-b6c3881bcfb1 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:17.390796 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-27fd7227-ac24-476a-8334-b6c3881bcfb1 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: aafabce5-30ac-488a-9d85-2d453337bf71] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:17.394725 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3dda28d3-80a0-4fac-88b5-34eab6352a40 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:17.395177 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3dda28d3-80a0-4fac-88b5-34eab6352a40 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:17.395939 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3dda28d3-80a0-4fac-88b5-34eab6352a40 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:17.396370 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3dda28d3-80a0-4fac-88b5-34eab6352a40 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:17.397112 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-27fd7227-ac24-476a-8334-b6c3881bcfb1 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:17.397569 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-27fd7227-ac24-476a-8334-b6c3881bcfb1 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:17.398362 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-27fd7227-ac24-476a-8334-b6c3881bcfb1 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:17.398801 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-27fd7227-ac24-476a-8334-b6c3881bcfb1 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:17.592148 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-3dda28d3-80a0-4fac-88b5-34eab6352a40 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:46:17.595356 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-27fd7227-ac24-476a-8334-b6c3881bcfb1 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:46:17.599961 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-3dda28d3-80a0-4fac-88b5-34eab6352a40 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 200 len: 1672 microversion: 2.1 time: 0.216533 May 23 15:46:17.600615 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 270/518] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:17 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 1672 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:46:17.602897 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-27fd7227-ac24-476a-8334-b6c3881bcfb1 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/aafabce5-30ac-488a-9d85-2d453337bf71" status: 200 len: 1681 microversion: 2.1 time: 0.217066 May 23 15:46:17.603456 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 249/519] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:17 2022] GET /compute/v2.1/servers/aafabce5-30ac-488a-9d85-2d453337bf71 => generated 1681 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:46:18.618705 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-e81979de-f734-4287-8125-261a9df2373a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:18.619331 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-e81979de-f734-4287-8125-261a9df2373a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:18.620569 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-6402957f-acfa-4997-930d-f83ea1618123 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:18.621733 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-6402957f-acfa-4997-930d-f83ea1618123 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: aafabce5-30ac-488a-9d85-2d453337bf71] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:18.628066 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e81979de-f734-4287-8125-261a9df2373a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:18.629414 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e81979de-f734-4287-8125-261a9df2373a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:18.630564 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e81979de-f734-4287-8125-261a9df2373a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:18.631685 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e81979de-f734-4287-8125-261a9df2373a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:18.640912 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-6402957f-acfa-4997-930d-f83ea1618123 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:18.641684 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-6402957f-acfa-4997-930d-f83ea1618123 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:18.642437 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-6402957f-acfa-4997-930d-f83ea1618123 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:18.642884 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-6402957f-acfa-4997-930d-f83ea1618123 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:18.767706 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-e81979de-f734-4287-8125-261a9df2373a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:46:18.776102 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-e81979de-f734-4287-8125-261a9df2373a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 200 len: 1604 microversion: 2.1 time: 0.162585 May 23 15:46:18.776931 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 271/520] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:18 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 1604 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:46:18.783386 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [req-296b72d8-abb7-4d0b-a019-e6da046c43e2 req-75dfb24a-25d9-4d76-a7ed-8a80540acdf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "800dd67c-e6dd-4712-9fe6-8d823b845358", "name": "network-vif-deleted", "tag": "f434c841-96a2-4c6e-a73f-0d44004c417c"}]} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:46:18.792540 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-296b72d8-abb7-4d0b-a019-e6da046c43e2 req-75dfb24a-25d9-4d76-a7ed-8a80540acdf0 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:18.795111 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-296b72d8-abb7-4d0b-a019-e6da046c43e2 req-75dfb24a-25d9-4d76-a7ed-8a80540acdf0 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:18.807938 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.compute.server_external_events [req-296b72d8-abb7-4d0b-a019-e6da046c43e2 req-75dfb24a-25d9-4d76-a7ed-8a80540acdf0 service nova] Creating event network-vif-deleted:f434c841-96a2-4c6e-a73f-0d44004c417c for instance 800dd67c-e6dd-4712-9fe6-8d823b845358 on hv-cinder-84067 May 23 15:46:18.814625 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [req-296b72d8-abb7-4d0b-a019-e6da046c43e2 req-75dfb24a-25d9-4d76-a7ed-8a80540acdf0 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035497 May 23 15:46:18.815514 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 272/521] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:46:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:46:18.821143 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [req-5d2052a5-64c1-4d8d-a9ae-55f6dc63ca4e req-65578b4e-4770-4f59-a045-66dd0fe0fcef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aafabce5-30ac-488a-9d85-2d453337bf71", "name": "network-vif-deleted", "tag": "835b3c97-b279-41ce-9d47-79f0eb6219e8"}]} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:46:18.831665 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-5d2052a5-64c1-4d8d-a9ae-55f6dc63ca4e req-65578b4e-4770-4f59-a045-66dd0fe0fcef service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:18.832769 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-5d2052a5-64c1-4d8d-a9ae-55f6dc63ca4e req-65578b4e-4770-4f59-a045-66dd0fe0fcef service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:18.864135 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.compute.server_external_events [req-5d2052a5-64c1-4d8d-a9ae-55f6dc63ca4e req-65578b4e-4770-4f59-a045-66dd0fe0fcef service nova] Creating event network-vif-deleted:835b3c97-b279-41ce-9d47-79f0eb6219e8 for instance aafabce5-30ac-488a-9d85-2d453337bf71 on hv-cinder-84067 May 23 15:46:18.882109 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [req-5d2052a5-64c1-4d8d-a9ae-55f6dc63ca4e req-65578b4e-4770-4f59-a045-66dd0fe0fcef service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060093 May 23 15:46:18.882975 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 273/522] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:46:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:46:19.109368 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-6402957f-acfa-4997-930d-f83ea1618123 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:46:19.117744 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-6402957f-acfa-4997-930d-f83ea1618123 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/aafabce5-30ac-488a-9d85-2d453337bf71" status: 200 len: 1613 microversion: 2.1 time: 0.501276 May 23 15:46:19.118628 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 250/523] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:18 2022] GET /compute/v2.1/servers/aafabce5-30ac-488a-9d85-2d453337bf71 => generated 1613 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:46:19.801295 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-fbb8cef2-3cf2-48fd-b7bb-9fc1feee8a0b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:19.802425 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-fbb8cef2-3cf2-48fd-b7bb-9fc1feee8a0b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:19.810329 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-fbb8cef2-3cf2-48fd-b7bb-9fc1feee8a0b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:19.811186 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-fbb8cef2-3cf2-48fd-b7bb-9fc1feee8a0b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:19.812220 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-fbb8cef2-3cf2-48fd-b7bb-9fc1feee8a0b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:19.812876 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-fbb8cef2-3cf2-48fd-b7bb-9fc1feee8a0b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:19.902505 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-fbb8cef2-3cf2-48fd-b7bb-9fc1feee8a0b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:19.903464 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-fbb8cef2-3cf2-48fd-b7bb-9fc1feee8a0b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:19.904208 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.objects.instance [None req-fbb8cef2-3cf2-48fd-b7bb-9fc1feee8a0b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lazy-loading 'fault' on Instance uuid 800dd67c-e6dd-4712-9fe6-8d823b845358 {{(pid=124934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 15:46:19.966716 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-fbb8cef2-3cf2-48fd-b7bb-9fc1feee8a0b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:46:19.981952 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-fbb8cef2-3cf2-48fd-b7bb-9fc1feee8a0b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 200 len: 1326 microversion: 2.1 time: 0.183501 May 23 15:46:19.981952 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 274/524] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:19 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 1326 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:46:20.136509 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-9a3774aa-9b35-4f8e-a872-d5babc05dfd3 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:20.137360 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-9a3774aa-9b35-4f8e-a872-d5babc05dfd3 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: aafabce5-30ac-488a-9d85-2d453337bf71] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:20.144225 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-9a3774aa-9b35-4f8e-a872-d5babc05dfd3 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:20.144771 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-9a3774aa-9b35-4f8e-a872-d5babc05dfd3 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:20.145649 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-9a3774aa-9b35-4f8e-a872-d5babc05dfd3 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:20.146318 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-9a3774aa-9b35-4f8e-a872-d5babc05dfd3 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:20.186135 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-9a3774aa-9b35-4f8e-a872-d5babc05dfd3 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:20.186676 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-9a3774aa-9b35-4f8e-a872-d5babc05dfd3 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:20.187232 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.objects.instance [None req-9a3774aa-9b35-4f8e-a872-d5babc05dfd3 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lazy-loading 'fault' on Instance uuid aafabce5-30ac-488a-9d85-2d453337bf71 {{(pid=124933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 15:46:20.232222 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-9a3774aa-9b35-4f8e-a872-d5babc05dfd3 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:46:20.243712 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-9a3774aa-9b35-4f8e-a872-d5babc05dfd3 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/aafabce5-30ac-488a-9d85-2d453337bf71" status: 200 len: 1330 microversion: 2.1 time: 0.108134 May 23 15:46:20.243712 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 251/525] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:20 2022] GET /compute/v2.1/servers/aafabce5-30ac-488a-9d85-2d453337bf71 => generated 1330 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:46:20.995685 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-64efedda-ca66-4ba5-a8d9-f27e049bf7ed tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:20.996218 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-64efedda-ca66-4ba5-a8d9-f27e049bf7ed tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:21.003166 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-64efedda-ca66-4ba5-a8d9-f27e049bf7ed tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:21.003627 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-64efedda-ca66-4ba5-a8d9-f27e049bf7ed tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:21.004424 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-64efedda-ca66-4ba5-a8d9-f27e049bf7ed tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:21.004869 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-64efedda-ca66-4ba5-a8d9-f27e049bf7ed tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:21.021227 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.wsgi [None req-64efedda-ca66-4ba5-a8d9-f27e049bf7ed tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] HTTP exception thrown: Instance 800dd67c-e6dd-4712-9fe6-8d823b845358 could not be found. May 23 15:46:21.022922 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-64efedda-ca66-4ba5-a8d9-f27e049bf7ed tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Request method failure captured: May 23 15:46:21.022922 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: request: GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 HTTP/1.1 May 23 15:46:21.022922 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Accept: application/json May 23 15:46:21.022922 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Accept-Encoding: identity May 23 15:46:21.022922 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Connection: close May 23 15:46:21.022922 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Content-Length: 0 May 23 15:46:21.022922 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Content-Type: application/json May 23 15:46:21.022922 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Host: 10.222.0.64 May 23 15:46:21.022922 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Openstack-System-Scope: None May 23 15:46:21.022922 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: User-Agent: python-urllib3/1.26.9 May 23 15:46:21.022922 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Auth-Token: gAAAAABii6s5te8GOjKrfAiv0Xf4k5hpEIekrfbYkgWsUlONJEd5IzBjOwa-F0NrdS9U2FReEjSKki20nknUbrI8hjkEKlGxJYFyk8iHUDzAljl1LnKqWL1Ulq6dP7R2suSMvGgQbwdVVqnorKIgEad5uHXYWrgLbilvMKjMAuNuN-pGwRi0zuM May 23 15:46:21.022922 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Domain-Id: None May 23 15:46:21.022922 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Domain-Name: None May 23 15:46:21.022922 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Identity-Status: Confirmed May 23 15:46:21.022922 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Is-Admin-Project: True May 23 15:46:21.022922 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Domain-Id: default May 23 15:46:21.022922 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Domain-Name: Default May 23 15:46:21.022922 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Id: 8d7ac236cd4d414fb70eb8da6da53484 May 23 15:46:21.022922 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Name: tempest-AttachVolumeTestJSON-945416102 May 23 15:46:21.022922 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Role: reader,member May 23 15:46:21.022922 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Roles: reader,member May 23 15:46:21.024572 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/8d7ac236cd4d414fb70eb8da6da53484"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/8d7ac236cd4d414fb70eb8da6da53484"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/8d7ac236cd4d414fb70eb8da6da53484"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_8d7ac236cd4d414fb70eb8da6da53484", "adminURL": "http://10.222.0.64:8080"}]}] May 23 15:46:21.024572 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant: tempest-AttachVolumeTestJSON-945416102 May 23 15:46:21.024572 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant-Id: 8d7ac236cd4d414fb70eb8da6da53484 May 23 15:46:21.024572 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant-Name: tempest-AttachVolumeTestJSON-945416102 May 23 15:46:21.024572 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User: tempest-AttachVolumeTestJSON-945416102-project May 23 15:46:21.024572 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Domain-Id: default May 23 15:46:21.024572 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Domain-Name: Default May 23 15:46:21.024572 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Id: 5236a93fc3a84d27bf3d150e85eb2589 May 23 15:46:21.024572 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Name: tempest-AttachVolumeTestJSON-945416102-project May 23 15:46:21.024572 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: method: > May 23 15:46:21.024572 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: exception: Instance 800dd67c-e6dd-4712-9fe6-8d823b845358 could not be found. May 23 15:46:21.024572 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: action_args: {'id': '800dd67c-e6dd-4712-9fe6-8d823b845358'} May 23 15:46:21.025492 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:46:21.025492 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:46:21.025492 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:46:21.025492 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:46:21.025492 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:46:21.025492 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:46:21.025492 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:46:21.025492 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:46:21.025492 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:46:21.025492 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:46:21.025492 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 800dd67c-e6dd-4712-9fe6-8d823b845358 could not be found. May 23 15:46:21.025492 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:46:21.025492 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:46:21.025492 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:46:21.025492 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:46:21.025492 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:46:21.025492 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:46:21.025492 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:46:21.025492 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:46:21.025492 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:46:21.026979 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:46:21.026979 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 15:46:21.026979 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 15:46:21.026979 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:46:21.026979 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:46:21.026979 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:46:21.026979 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:46:21.026979 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 800dd67c-e6dd-4712-9fe6-8d823b845358 could not be found. May 23 15:46:21.026979 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:46:21.026979 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:46:21.026979 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:46:21.026979 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:46:21.026979 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:46:21.026979 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:46:21.026979 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:46:21.026979 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:46:21.026979 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 800dd67c-e6dd-4712-9fe6-8d823b845358 could not be found. May 23 15:46:21.026979 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:46:21.029000 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-64efedda-ca66-4ba5-a8d9-f27e049bf7ed tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Returning 404 to user: Instance 800dd67c-e6dd-4712-9fe6-8d823b845358 could not be found. {{(pid=124934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:46:21.029000 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-64efedda-ca66-4ba5-a8d9-f27e049bf7ed tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 404 len: 111 microversion: 2.1 time: 0.032648 May 23 15:46:21.029000 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 275/526] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:20 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 15:46:21.034002 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-4026c88e-ba2b-4b98-bd5f-05dec369e97b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '.version_select at 0x7fab51ea9670>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:21.037543 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4026c88e-ba2b-4b98-bd5f-05dec369e97b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [84ed031f-2802-4b84-9ab0-2103427627ab] AMQP server on 10.222.0.64:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 23 15:46:21.258037 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-e1326e96-349b-480e-b1be-6e990821a2ce tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:21.258562 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-e1326e96-349b-480e-b1be-6e990821a2ce tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: aafabce5-30ac-488a-9d85-2d453337bf71] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:21.264596 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e1326e96-349b-480e-b1be-6e990821a2ce tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:21.265051 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e1326e96-349b-480e-b1be-6e990821a2ce tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:21.265848 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e1326e96-349b-480e-b1be-6e990821a2ce tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:21.266279 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e1326e96-349b-480e-b1be-6e990821a2ce tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:21.279287 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.wsgi [None req-e1326e96-349b-480e-b1be-6e990821a2ce tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] HTTP exception thrown: Instance aafabce5-30ac-488a-9d85-2d453337bf71 could not be found. May 23 15:46:21.280806 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-e1326e96-349b-480e-b1be-6e990821a2ce tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Request method failure captured: May 23 15:46:21.280806 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: request: GET /compute/v2.1/servers/aafabce5-30ac-488a-9d85-2d453337bf71 HTTP/1.1 May 23 15:46:21.280806 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Accept: application/json May 23 15:46:21.280806 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Accept-Encoding: identity May 23 15:46:21.280806 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Connection: close May 23 15:46:21.280806 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Content-Length: 0 May 23 15:46:21.280806 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Content-Type: application/json May 23 15:46:21.280806 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Host: 10.222.0.64 May 23 15:46:21.280806 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Openstack-System-Scope: None May 23 15:46:21.280806 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: User-Agent: python-urllib3/1.26.9 May 23 15:46:21.280806 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Auth-Token: gAAAAABii6uOGntB7Pc55mvjpSIsPzNLOlywCYGbr_-Vzy5_quOX_mjNj5PwEdU1U5x_QaGgk51iZzj3S4TZVzOIWCHWkRILSGjcG5ZDd1N2DadGTyYCWvrZ0p61UD6zAV5lw6yOUFVzzVm3KSoYQSF_ZlPFocwbQbQqnGoN6Tr34TmSqfoSNW8 May 23 15:46:21.280806 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Domain-Id: None May 23 15:46:21.280806 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Domain-Name: None May 23 15:46:21.280806 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Identity-Status: Confirmed May 23 15:46:21.280806 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Is-Admin-Project: True May 23 15:46:21.280806 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Domain-Id: default May 23 15:46:21.280806 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Domain-Name: Default May 23 15:46:21.280806 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Id: a15ae9d15a64468f80628ed51c2e42d6 May 23 15:46:21.280806 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Name: tempest-AttachVolumeNegativeTest-2009285566 May 23 15:46:21.280806 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Role: reader,member May 23 15:46:21.280806 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Roles: reader,member May 23 15:46:21.282393 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a15ae9d15a64468f80628ed51c2e42d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a15ae9d15a64468f80628ed51c2e42d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a15ae9d15a64468f80628ed51c2e42d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a15ae9d15a64468f80628ed51c2e42d6", "adminURL": "http://10.222.0.64:8080"}]}] May 23 15:46:21.282393 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant: tempest-AttachVolumeNegativeTest-2009285566 May 23 15:46:21.282393 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant-Id: a15ae9d15a64468f80628ed51c2e42d6 May 23 15:46:21.282393 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2009285566 May 23 15:46:21.282393 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User: tempest-AttachVolumeNegativeTest-2009285566-project May 23 15:46:21.282393 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Domain-Id: default May 23 15:46:21.282393 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Domain-Name: Default May 23 15:46:21.282393 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Id: 472049224bbf48699b8a9410ec61aa9e May 23 15:46:21.282393 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Name: tempest-AttachVolumeNegativeTest-2009285566-project May 23 15:46:21.282393 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: method: > May 23 15:46:21.282393 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: exception: Instance aafabce5-30ac-488a-9d85-2d453337bf71 could not be found. May 23 15:46:21.282393 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: action_args: {'id': 'aafabce5-30ac-488a-9d85-2d453337bf71'} May 23 15:46:21.286784 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:46:21.286784 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:46:21.286784 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:46:21.286784 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:46:21.286784 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:46:21.286784 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:46:21.286784 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:46:21.286784 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:46:21.286784 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:46:21.286784 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:46:21.286784 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aafabce5-30ac-488a-9d85-2d453337bf71 could not be found. May 23 15:46:21.286784 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:46:21.286784 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:46:21.286784 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:46:21.286784 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:46:21.286784 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:46:21.286784 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:46:21.286784 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:46:21.286784 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:46:21.286784 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:46:21.288227 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:46:21.288227 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 15:46:21.288227 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 15:46:21.288227 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:46:21.288227 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:46:21.288227 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:46:21.288227 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:46:21.288227 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aafabce5-30ac-488a-9d85-2d453337bf71 could not be found. May 23 15:46:21.288227 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:46:21.288227 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:46:21.288227 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:46:21.288227 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:46:21.288227 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:46:21.288227 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:46:21.288227 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:46:21.288227 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:46:21.288227 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aafabce5-30ac-488a-9d85-2d453337bf71 could not be found. May 23 15:46:21.288227 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:46:21.289665 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-e1326e96-349b-480e-b1be-6e990821a2ce tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Returning 404 to user: Instance aafabce5-30ac-488a-9d85-2d453337bf71 could not be found. {{(pid=124934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:46:21.289665 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-e1326e96-349b-480e-b1be-6e990821a2ce tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/aafabce5-30ac-488a-9d85-2d453337bf71" status: 404 len: 111 microversion: 2.1 time: 0.028084 May 23 15:46:21.289665 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 276/527] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:21 2022] GET /compute/v2.1/servers/aafabce5-30ac-488a-9d85-2d453337bf71 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 23 15:46:21.290415 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-f2e35640-c4e3-4904-a32f-0cfb04fa5006 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '.version_select at 0x7fab54764e50>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:21.352118 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-f2e35640-c4e3-4904-a32f-0cfb04fa5006 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-565907814" status: 202 len: 0 microversion: 2.1 time: 0.064868 May 23 15:46:21.352655 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 277/528] 10.222.0.64 () {58 vars in 1217 bytes} [Mon May 23 15:46:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-565907814 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 23 15:46:22.047296 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO oslo.messaging._drivers.impl_rabbit [None req-4026c88e-ba2b-4b98-bd5f-05dec369e97b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [84ed031f-2802-4b84-9ab0-2103427627ab] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 37294. May 23 15:46:22.117915 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-4026c88e-ba2b-4b98-bd5f-05dec369e97b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-518645918" status: 202 len: 0 microversion: 2.1 time: 1.087726 May 23 15:46:22.118492 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 252/529] 10.222.0.64 () {58 vars in 1217 bytes} [Mon May 23 15:46:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-518645918 => generated 0 bytes in 1089 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 15:46:22.174416 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-3d1a7ab3-93a6-4c1b-b4b2-591ad2cf1dfa tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:22.174970 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-3d1a7ab3-93a6-4c1b-b4b2-591ad2cf1dfa tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: ce2cd056-b2f1-43fb-a60a-323039d15162] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:22.181719 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3d1a7ab3-93a6-4c1b-b4b2-591ad2cf1dfa tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:22.182041 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3d1a7ab3-93a6-4c1b-b4b2-591ad2cf1dfa tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:22.182823 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3d1a7ab3-93a6-4c1b-b4b2-591ad2cf1dfa tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:22.183263 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3d1a7ab3-93a6-4c1b-b4b2-591ad2cf1dfa tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:22.305208 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.objects.instance [None req-3d1a7ab3-93a6-4c1b-b4b2-591ad2cf1dfa tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lazy-loading 'services' on Instance uuid ce2cd056-b2f1-43fb-a60a-323039d15162 {{(pid=124934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 15:46:22.613468 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-3d1a7ab3-93a6-4c1b-b4b2-591ad2cf1dfa tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "DELETE /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162/os-volume_attachments/8f0ad502-a7fc-4cd6-803d-e41ae63f7048" status: 202 len: 0 microversion: 2.1 time: 0.443403 May 23 15:46:22.614091 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 278/530] 10.222.0.64 () {58 vars in 1415 bytes} [Mon May 23 15:46:22 2022] DELETE /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162/os-volume_attachments/8f0ad502-a7fc-4cd6-803d-e41ae63f7048 => generated 0 bytes in 445 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 15:46:22.623069 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-ea3d9b55-ac48-4786-bed3-7fdacb170e0a tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:22.624142 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-ea3d9b55-ac48-4786-bed3-7fdacb170e0a tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: ce2cd056-b2f1-43fb-a60a-323039d15162] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:22.638301 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ea3d9b55-ac48-4786-bed3-7fdacb170e0a tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:22.639785 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ea3d9b55-ac48-4786-bed3-7fdacb170e0a tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:22.639785 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ea3d9b55-ac48-4786-bed3-7fdacb170e0a tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:22.640082 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ea3d9b55-ac48-4786-bed3-7fdacb170e0a tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:22.671082 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-ea3d9b55-ac48-4786-bed3-7fdacb170e0a tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052522 May 23 15:46:22.671774 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 253/531] 10.222.0.64 () {58 vars in 1301 bytes} [Mon May 23 15:46:22 2022] GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:46:22.873964 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-836fe776-6203-49c4-a1ea-d076b6fac17d tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Action: 'create', calling method: .version_select at 0x7fab5212ae50>, body: {"keypair": {"name": "tempest-keypair-1058836153", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK7lkuOXlWDYQl2xsiqnl4TtDDeaJaUDV+u/g1M1v4WfHXuMsCTgxvjv6kX4WWH0gZ/RdlOlGrPWFqsbrQy3b1RbFQ37AVvfWCZgJjNpdRCUgppWZgmk5LliRwbwEGWOpg=="}} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:46:22.887407 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.quota [None req-836fe776-6203-49c4-a1ea-d076b6fac17d tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Getting quotas for project 8d7ac236cd4d414fb70eb8da6da53484. Resources: {'key_pairs'} {{(pid=124934) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 15:46:22.892328 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.quota [None req-836fe776-6203-49c4-a1ea-d076b6fac17d tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Getting quotas for user 5236a93fc3a84d27bf3d150e85eb2589 and project 8d7ac236cd4d414fb70eb8da6da53484. Resources: {'key_pairs'} {{(pid=124934) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 15:46:22.996985 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-836fe776-6203-49c4-a1ea-d076b6fac17d tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.127826 May 23 15:46:22.997607 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 279/532] 10.222.0.64 () {60 vars in 1158 bytes} [Mon May 23 15:46:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:46:23.683065 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-f0d4f199-15f4-4b6b-a237-aee3137f1fb8 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:23.683991 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-f0d4f199-15f4-4b6b-a237-aee3137f1fb8 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: ce2cd056-b2f1-43fb-a60a-323039d15162] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:23.691818 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-f0d4f199-15f4-4b6b-a237-aee3137f1fb8 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:23.692268 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-f0d4f199-15f4-4b6b-a237-aee3137f1fb8 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:23.693091 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-f0d4f199-15f4-4b6b-a237-aee3137f1fb8 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:23.693529 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-f0d4f199-15f4-4b6b-a237-aee3137f1fb8 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:23.723254 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-f0d4f199-15f4-4b6b-a237-aee3137f1fb8 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044074 May 23 15:46:23.723808 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 254/533] 10.222.0.64 () {58 vars in 1301 bytes} [Mon May 23 15:46:23 2022] GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:46:24.735285 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-0d85c9d5-db1c-47f5-b14c-2fd49313142b tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:24.736423 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-0d85c9d5-db1c-47f5-b14c-2fd49313142b tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: ce2cd056-b2f1-43fb-a60a-323039d15162] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:24.742751 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0d85c9d5-db1c-47f5-b14c-2fd49313142b tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:24.743206 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0d85c9d5-db1c-47f5-b14c-2fd49313142b tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:24.743984 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0d85c9d5-db1c-47f5-b14c-2fd49313142b tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:24.744430 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0d85c9d5-db1c-47f5-b14c-2fd49313142b tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:24.777574 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-0d85c9d5-db1c-47f5-b14c-2fd49313142b tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046461 May 23 15:46:24.778122 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 280/534] 10.222.0.64 () {58 vars in 1301 bytes} [Mon May 23 15:46:24 2022] GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 15:46:24.837719 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-d4fe2ff0-44f2-4fec-b94b-b8769d0b6370 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:24.838268 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-d4fe2ff0-44f2-4fec-b94b-b8769d0b6370 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: ce2cd056-b2f1-43fb-a60a-323039d15162] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:24.845305 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-d4fe2ff0-44f2-4fec-b94b-b8769d0b6370 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:24.847772 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-d4fe2ff0-44f2-4fec-b94b-b8769d0b6370 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:24.847772 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-d4fe2ff0-44f2-4fec-b94b-b8769d0b6370 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:24.847772 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-d4fe2ff0-44f2-4fec-b94b-b8769d0b6370 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:24.875583 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-d4fe2ff0-44f2-4fec-b94b-b8769d0b6370 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: ce2cd056-b2f1-43fb-a60a-323039d15162] Going to try to terminate instance {{(pid=124933) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 15:46:25.184684 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-d4fe2ff0-44f2-4fec-b94b-b8769d0b6370 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "DELETE /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162" status: 204 len: 0 microversion: 2.1 time: 0.350464 May 23 15:46:25.185401 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 255/535] 10.222.0.64 () {58 vars in 1238 bytes} [Mon May 23 15:46:24 2022] DELETE /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 15:46:25.192198 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-879c0de5-cefc-409b-b804-960e4dbe4e2a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1546263558", "imageRef": "a5c8503f-3733-426f-8a5b-c7c9358e4a45", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "02514ff5-801e-4a1a-ba63-1d21a54e8a97"}], "security_groups": [{"name": "tempest-securitygroup--1157029551"}], "key_name": "tempest-keypair-1058836153", "user_data": "}} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:46:25.199740 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-a839b787-dcc8-4d56-a49c-d869e3dd2bd9 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:25.200439 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-a839b787-dcc8-4d56-a49c-d869e3dd2bd9 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: ce2cd056-b2f1-43fb-a60a-323039d15162] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:25.207583 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a839b787-dcc8-4d56-a49c-d869e3dd2bd9 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:25.208038 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a839b787-dcc8-4d56-a49c-d869e3dd2bd9 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:25.208803 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a839b787-dcc8-4d56-a49c-d869e3dd2bd9 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:25.209281 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a839b787-dcc8-4d56-a49c-d869e3dd2bd9 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:25.340752 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.network.neutron [None req-879c0de5-cefc-409b-b804-960e4dbe4e2a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] validate_networks() for [('02514ff5-801e-4a1a-ba63-1d21a54e8a97', None, None, None, None, None)] {{(pid=124934) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 15:46:25.415038 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-a839b787-dcc8-4d56-a49c-d869e3dd2bd9 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:46:25.422510 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-a839b787-dcc8-4d56-a49c-d869e3dd2bd9 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162" status: 200 len: 1680 microversion: 2.1 time: 0.226672 May 23 15:46:25.423077 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 256/536] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:25 2022] GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162 => generated 1680 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:46:25.722682 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.virt.hardware [None req-879c0de5-cefc-409b-b804-960e4dbe4e2a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Flavor limits 0:0:0 {{(pid=124934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 15:46:25.722682 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.virt.hardware [None req-879c0de5-cefc-409b-b804-960e4dbe4e2a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Image limits 0:0:0 {{(pid=124934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 15:46:25.722919 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.virt.hardware [None req-879c0de5-cefc-409b-b804-960e4dbe4e2a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Flavor pref 0:0:0 {{(pid=124934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 15:46:25.723311 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.virt.hardware [None req-879c0de5-cefc-409b-b804-960e4dbe4e2a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Image pref 0:0:0 {{(pid=124934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 15:46:25.723736 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.virt.hardware [None req-879c0de5-cefc-409b-b804-960e4dbe4e2a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 15:46:25.732491 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-879c0de5-cefc-409b-b804-960e4dbe4e2a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:25.732949 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-879c0de5-cefc-409b-b804-960e4dbe4e2a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:25.734311 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-879c0de5-cefc-409b-b804-960e4dbe4e2a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:25.734750 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-879c0de5-cefc-409b-b804-960e4dbe4e2a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:25.751855 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.quota [None req-879c0de5-cefc-409b-b804-960e4dbe4e2a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Getting quotas for project 8d7ac236cd4d414fb70eb8da6da53484. Resources: {'ram', 'instances', 'cores'} {{(pid=124934) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 15:46:25.755877 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.quota [None req-879c0de5-cefc-409b-b804-960e4dbe4e2a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Getting quotas for user 5236a93fc3a84d27bf3d150e85eb2589 and project 8d7ac236cd4d414fb70eb8da6da53484. Resources: {'ram', 'instances', 'cores'} {{(pid=124934) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 15:46:25.767122 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-879c0de5-cefc-409b-b804-960e4dbe4e2a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Going to run 1 instances... {{(pid=124934) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 15:46:25.769411 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-879c0de5-cefc-409b-b804-960e4dbe4e2a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 53a161fc-db24-4861-8e60-b1e29465366e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5c8503f-3733-426f-8a5b-c7c9358e4a45',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124934) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 15:46:25.909378 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR oslo.messaging._drivers.impl_rabbit [None req-879c0de5-cefc-409b-b804-960e4dbe4e2a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [dc53ed7b-d44d-4571-9569-f59230927f8d] AMQP server on 10.222.0.64:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 23 15:46:26.440049 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-da7d7e3a-2ff3-480b-9162-fcdd699931f3 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:26.440669 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-da7d7e3a-2ff3-480b-9162-fcdd699931f3 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: ce2cd056-b2f1-43fb-a60a-323039d15162] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:26.447141 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-da7d7e3a-2ff3-480b-9162-fcdd699931f3 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:26.447594 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-da7d7e3a-2ff3-480b-9162-fcdd699931f3 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:26.448349 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-da7d7e3a-2ff3-480b-9162-fcdd699931f3 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:26.448787 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-da7d7e3a-2ff3-480b-9162-fcdd699931f3 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:26.581495 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-da7d7e3a-2ff3-480b-9162-fcdd699931f3 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:46:26.585036 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:26.589467 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-da7d7e3a-2ff3-480b-9162-fcdd699931f3 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162" status: 200 len: 1680 microversion: 2.1 time: 0.153631 May 23 15:46:26.590025 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 257/537] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:26 2022] GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:46:26.915723 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO oslo.messaging._drivers.impl_rabbit [None req-879c0de5-cefc-409b-b804-960e4dbe4e2a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [dc53ed7b-d44d-4571-9569-f59230927f8d] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 37348. May 23 15:46:26.919505 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-879c0de5-cefc-409b-b804-960e4dbe4e2a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.731582 May 23 15:46:26.920140 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 281/538] 10.222.0.64 () {60 vars in 1146 bytes} [Mon May 23 15:46:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 1734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 23 15:46:26.931393 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-0accf29f-0059-49a3-9aff-9f31b697ffda tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:26.932103 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-0accf29f-0059-49a3-9aff-9f31b697ffda tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 53a161fc-db24-4861-8e60-b1e29465366e] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:26.984692 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-0accf29f-0059-49a3-9aff-9f31b697ffda tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:46:26.991326 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-0accf29f-0059-49a3-9aff-9f31b697ffda tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e" status: 200 len: 1238 microversion: 2.1 time: 0.064272 May 23 15:46:26.991883 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 258/539] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:26 2022] GET /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e => generated 1238 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:46:27.607175 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-162c17ef-c5ec-4e11-b8ae-8361855f2de7 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:27.607798 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-162c17ef-c5ec-4e11-b8ae-8361855f2de7 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: ce2cd056-b2f1-43fb-a60a-323039d15162] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:27.614459 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-162c17ef-c5ec-4e11-b8ae-8361855f2de7 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:27.614920 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-162c17ef-c5ec-4e11-b8ae-8361855f2de7 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:27.615696 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-162c17ef-c5ec-4e11-b8ae-8361855f2de7 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:27.616190 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-162c17ef-c5ec-4e11-b8ae-8361855f2de7 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:27.763347 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-162c17ef-c5ec-4e11-b8ae-8361855f2de7 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:46:27.772546 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-162c17ef-c5ec-4e11-b8ae-8361855f2de7 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162" status: 200 len: 1680 microversion: 2.1 time: 0.169242 May 23 15:46:27.773448 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 282/540] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:27 2022] GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162 => generated 1680 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:46:28.007773 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-ac49e0cc-30d9-4f93-97bb-ae0bddb976f3 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:28.008393 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-ac49e0cc-30d9-4f93-97bb-ae0bddb976f3 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 53a161fc-db24-4861-8e60-b1e29465366e] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:28.014898 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ac49e0cc-30d9-4f93-97bb-ae0bddb976f3 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:28.015643 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ac49e0cc-30d9-4f93-97bb-ae0bddb976f3 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:28.016313 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ac49e0cc-30d9-4f93-97bb-ae0bddb976f3 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:28.016757 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ac49e0cc-30d9-4f93-97bb-ae0bddb976f3 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:28.080757 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-ac49e0cc-30d9-4f93-97bb-ae0bddb976f3 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:46:28.086941 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-ac49e0cc-30d9-4f93-97bb-ae0bddb976f3 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e" status: 200 len: 1242 microversion: 2.1 time: 0.083137 May 23 15:46:28.087507 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 259/541] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:28 2022] GET /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e => generated 1242 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:46:28.581325 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [req-d10b162e-8dcc-4ba3-ba17-c733a7524ccf req-22548d9a-86c4-4db5-ae12-5330872201d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce2cd056-b2f1-43fb-a60a-323039d15162", "name": "network-vif-deleted", "tag": "cefdd54f-7186-4994-802f-370961a2ffcb"}]} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:46:28.589480 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-d10b162e-8dcc-4ba3-ba17-c733a7524ccf req-22548d9a-86c4-4db5-ae12-5330872201d8 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:28.590005 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-d10b162e-8dcc-4ba3-ba17-c733a7524ccf req-22548d9a-86c4-4db5-ae12-5330872201d8 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:28.602202 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.compute.server_external_events [req-d10b162e-8dcc-4ba3-ba17-c733a7524ccf req-22548d9a-86c4-4db5-ae12-5330872201d8 service nova] Creating event network-vif-deleted:cefdd54f-7186-4994-802f-370961a2ffcb for instance ce2cd056-b2f1-43fb-a60a-323039d15162 on hv-cinder-84067 May 23 15:46:28.607304 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [req-d10b162e-8dcc-4ba3-ba17-c733a7524ccf req-22548d9a-86c4-4db5-ae12-5330872201d8 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031152 May 23 15:46:28.608179 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 283/542] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:46:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:46:28.789568 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-1a8deb4f-91b2-4c7f-ab47-327cd3b2cb47 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:28.790194 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-1a8deb4f-91b2-4c7f-ab47-327cd3b2cb47 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: ce2cd056-b2f1-43fb-a60a-323039d15162] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:28.799771 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1a8deb4f-91b2-4c7f-ab47-327cd3b2cb47 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:28.800225 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1a8deb4f-91b2-4c7f-ab47-327cd3b2cb47 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:28.801040 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1a8deb4f-91b2-4c7f-ab47-327cd3b2cb47 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:28.801510 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1a8deb4f-91b2-4c7f-ab47-327cd3b2cb47 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:28.868745 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-1a8deb4f-91b2-4c7f-ab47-327cd3b2cb47 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:46:28.877662 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-1a8deb4f-91b2-4c7f-ab47-327cd3b2cb47 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162" status: 200 len: 1613 microversion: 2.1 time: 0.092081 May 23 15:46:28.878241 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 260/543] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:28 2022] GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162 => generated 1613 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:46:29.104609 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-1c917606-0690-4e75-ae23-0fff1338e4ae tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:29.105356 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-1c917606-0690-4e75-ae23-0fff1338e4ae tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 53a161fc-db24-4861-8e60-b1e29465366e] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:29.114019 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-1c917606-0690-4e75-ae23-0fff1338e4ae tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:29.114496 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-1c917606-0690-4e75-ae23-0fff1338e4ae tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:29.115282 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-1c917606-0690-4e75-ae23-0fff1338e4ae tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:29.115720 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-1c917606-0690-4e75-ae23-0fff1338e4ae tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:29.244292 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-1c917606-0690-4e75-ae23-0fff1338e4ae tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:46:29.254739 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-1c917606-0690-4e75-ae23-0fff1338e4ae tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e" status: 200 len: 1298 microversion: 2.1 time: 0.154465 May 23 15:46:29.255671 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 284/544] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:29 2022] GET /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e => generated 1298 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:46:29.896176 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-f3e53e31-f78f-40f8-8b19-2d8595d9a9f1 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:29.896869 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-f3e53e31-f78f-40f8-8b19-2d8595d9a9f1 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: ce2cd056-b2f1-43fb-a60a-323039d15162] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:29.903249 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-f3e53e31-f78f-40f8-8b19-2d8595d9a9f1 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:29.903707 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-f3e53e31-f78f-40f8-8b19-2d8595d9a9f1 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:29.904480 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-f3e53e31-f78f-40f8-8b19-2d8595d9a9f1 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:29.904930 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-f3e53e31-f78f-40f8-8b19-2d8595d9a9f1 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:29.936395 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-f3e53e31-f78f-40f8-8b19-2d8595d9a9f1 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:29.937355 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-f3e53e31-f78f-40f8-8b19-2d8595d9a9f1 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:29.937847 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.objects.instance [None req-f3e53e31-f78f-40f8-8b19-2d8595d9a9f1 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lazy-loading 'fault' on Instance uuid ce2cd056-b2f1-43fb-a60a-323039d15162 {{(pid=124933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 15:46:30.000925 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-f3e53e31-f78f-40f8-8b19-2d8595d9a9f1 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:46:30.010777 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-f3e53e31-f78f-40f8-8b19-2d8595d9a9f1 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162" status: 200 len: 1331 microversion: 2.1 time: 0.118366 May 23 15:46:30.011339 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 261/545] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:29 2022] GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162 => generated 1331 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:46:30.277999 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-23b8f2ed-ccb3-4855-bdf5-8a61d58a311b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:30.278742 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-23b8f2ed-ccb3-4855-bdf5-8a61d58a311b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 53a161fc-db24-4861-8e60-b1e29465366e] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:30.285434 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-23b8f2ed-ccb3-4855-bdf5-8a61d58a311b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:30.285434 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-23b8f2ed-ccb3-4855-bdf5-8a61d58a311b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:30.286657 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-23b8f2ed-ccb3-4855-bdf5-8a61d58a311b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:30.287184 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-23b8f2ed-ccb3-4855-bdf5-8a61d58a311b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:30.291553 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:30.355009 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-23b8f2ed-ccb3-4855-bdf5-8a61d58a311b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:46:30.362868 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-23b8f2ed-ccb3-4855-bdf5-8a61d58a311b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e" status: 200 len: 1296 microversion: 2.1 time: 0.089617 May 23 15:46:30.363427 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 285/546] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:30 2022] GET /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e => generated 1296 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:46:31.027851 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-b7a3f721-248f-4786-a5c4-cd4c77138edc tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:31.028562 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-b7a3f721-248f-4786-a5c4-cd4c77138edc tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: ce2cd056-b2f1-43fb-a60a-323039d15162] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:31.038076 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b7a3f721-248f-4786-a5c4-cd4c77138edc tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:31.038076 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b7a3f721-248f-4786-a5c4-cd4c77138edc tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:31.038076 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b7a3f721-248f-4786-a5c4-cd4c77138edc tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:31.038076 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b7a3f721-248f-4786-a5c4-cd4c77138edc tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:31.053365 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.wsgi [None req-b7a3f721-248f-4786-a5c4-cd4c77138edc tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] HTTP exception thrown: Instance ce2cd056-b2f1-43fb-a60a-323039d15162 could not be found. May 23 15:46:31.054930 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-b7a3f721-248f-4786-a5c4-cd4c77138edc tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Request method failure captured: May 23 15:46:31.054930 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: request: GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162 HTTP/1.1 May 23 15:46:31.054930 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Accept: application/json May 23 15:46:31.054930 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Accept-Encoding: identity May 23 15:46:31.054930 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Connection: close May 23 15:46:31.054930 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Content-Length: 0 May 23 15:46:31.054930 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Content-Type: application/json May 23 15:46:31.054930 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Host: 10.222.0.64 May 23 15:46:31.054930 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Openstack-System-Scope: None May 23 15:46:31.054930 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: User-Agent: python-urllib3/1.26.9 May 23 15:46:31.054930 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Auth-Token: gAAAAABii6uOGntB7Pc55mvjpSIsPzNLOlywCYGbr_-Vzy5_quOX_mjNj5PwEdU1U5x_QaGgk51iZzj3S4TZVzOIWCHWkRILSGjcG5ZDd1N2DadGTyYCWvrZ0p61UD6zAV5lw6yOUFVzzVm3KSoYQSF_ZlPFocwbQbQqnGoN6Tr34TmSqfoSNW8 May 23 15:46:31.054930 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Domain-Id: None May 23 15:46:31.054930 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Domain-Name: None May 23 15:46:31.054930 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Identity-Status: Confirmed May 23 15:46:31.054930 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Is-Admin-Project: True May 23 15:46:31.054930 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Domain-Id: default May 23 15:46:31.054930 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Domain-Name: Default May 23 15:46:31.054930 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Id: a15ae9d15a64468f80628ed51c2e42d6 May 23 15:46:31.054930 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Name: tempest-AttachVolumeNegativeTest-2009285566 May 23 15:46:31.054930 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Role: reader,member May 23 15:46:31.054930 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Roles: reader,member May 23 15:46:31.056521 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a15ae9d15a64468f80628ed51c2e42d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a15ae9d15a64468f80628ed51c2e42d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a15ae9d15a64468f80628ed51c2e42d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a15ae9d15a64468f80628ed51c2e42d6", "adminURL": "http://10.222.0.64:8080"}]}] May 23 15:46:31.056521 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant: tempest-AttachVolumeNegativeTest-2009285566 May 23 15:46:31.056521 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant-Id: a15ae9d15a64468f80628ed51c2e42d6 May 23 15:46:31.056521 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2009285566 May 23 15:46:31.056521 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User: tempest-AttachVolumeNegativeTest-2009285566-project May 23 15:46:31.056521 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Domain-Id: default May 23 15:46:31.056521 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Domain-Name: Default May 23 15:46:31.056521 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Id: 472049224bbf48699b8a9410ec61aa9e May 23 15:46:31.056521 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Name: tempest-AttachVolumeNegativeTest-2009285566-project May 23 15:46:31.056521 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: method: > May 23 15:46:31.056521 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: exception: Instance ce2cd056-b2f1-43fb-a60a-323039d15162 could not be found. May 23 15:46:31.056521 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: action_args: {'id': 'ce2cd056-b2f1-43fb-a60a-323039d15162'} May 23 15:46:31.057390 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:46:31.057390 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:46:31.057390 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:46:31.057390 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:46:31.057390 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:46:31.057390 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:46:31.057390 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:46:31.057390 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:46:31.057390 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:46:31.057390 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:46:31.057390 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce2cd056-b2f1-43fb-a60a-323039d15162 could not be found. May 23 15:46:31.057390 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:46:31.057390 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:46:31.057390 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:46:31.057390 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:46:31.057390 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:46:31.057390 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:46:31.057390 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:46:31.057390 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:46:31.057390 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:46:31.058848 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:46:31.058848 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 15:46:31.058848 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 15:46:31.058848 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:46:31.058848 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:46:31.058848 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:46:31.058848 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:46:31.058848 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce2cd056-b2f1-43fb-a60a-323039d15162 could not be found. May 23 15:46:31.058848 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:46:31.058848 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:46:31.058848 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:46:31.058848 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:46:31.058848 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:46:31.058848 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:46:31.058848 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:46:31.058848 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:46:31.058848 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce2cd056-b2f1-43fb-a60a-323039d15162 could not be found. May 23 15:46:31.058848 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:46:31.060138 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-b7a3f721-248f-4786-a5c4-cd4c77138edc tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Returning 404 to user: Instance ce2cd056-b2f1-43fb-a60a-323039d15162 could not be found. {{(pid=124933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:46:31.060138 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-b7a3f721-248f-4786-a5c4-cd4c77138edc tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162" status: 404 len: 111 microversion: 2.1 time: 0.032399 May 23 15:46:31.060138 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 262/547] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:31 2022] GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 15:46:31.065630 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-4f574d22-1dd2-4c30-bb61-1ad83f633690 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '.version_select at 0x7fab520b9d30>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:31.140737 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-4f574d22-1dd2-4c30-bb61-1ad83f633690 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1168517304" status: 202 len: 0 microversion: 2.1 time: 0.079211 May 23 15:46:31.141406 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 286/548] 10.222.0.64 () {58 vars in 1220 bytes} [Mon May 23 15:46:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1168517304 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 15:46:31.383040 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-a7867914-fc16-48db-bdb3-26323b9892d5 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:31.384184 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-a7867914-fc16-48db-bdb3-26323b9892d5 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 53a161fc-db24-4861-8e60-b1e29465366e] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:31.391014 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a7867914-fc16-48db-bdb3-26323b9892d5 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:31.391463 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a7867914-fc16-48db-bdb3-26323b9892d5 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:31.392336 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a7867914-fc16-48db-bdb3-26323b9892d5 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:31.392774 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a7867914-fc16-48db-bdb3-26323b9892d5 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:31.508344 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [req-0c816eeb-b9e4-4468-9420-b40f8733aa4c req-e4432b5f-a319-4a94-94ce-99937fc48d89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53a161fc-db24-4861-8e60-b1e29465366e", "tag": "75239bc1-69c6-438c-af43-de4ccb9f0f6d"}]} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:46:31.518198 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-0c816eeb-b9e4-4468-9420-b40f8733aa4c req-e4432b5f-a319-4a94-94ce-99937fc48d89 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:31.520552 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-0c816eeb-b9e4-4468-9420-b40f8733aa4c req-e4432b5f-a319-4a94-94ce-99937fc48d89 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:31.532369 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.compute.server_external_events [req-0c816eeb-b9e4-4468-9420-b40f8733aa4c req-e4432b5f-a319-4a94-94ce-99937fc48d89 service nova] Creating event network-changed:75239bc1-69c6-438c-af43-de4ccb9f0f6d for instance 53a161fc-db24-4861-8e60-b1e29465366e on hv-cinder-84067 May 23 15:46:31.543645 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-a7867914-fc16-48db-bdb3-26323b9892d5 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:46:31.551054 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [req-0c816eeb-b9e4-4468-9420-b40f8733aa4c req-e4432b5f-a319-4a94-94ce-99937fc48d89 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046471 May 23 15:46:31.551653 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 287/549] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:46:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:46:31.553946 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-a7867914-fc16-48db-bdb3-26323b9892d5 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e" status: 200 len: 1364 microversion: 2.1 time: 0.174785 May 23 15:46:31.554508 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 263/550] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:31 2022] GET /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e => generated 1364 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:46:32.260569 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-731f1347-0ec1-4333-bea0-ce7dcbc379d6 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Action: 'create', calling method: .version_select at 0x7fab5285c0d0>, body: {"keypair": {"name": "tempest-keypair-1447800045", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZ4WqrafZAPijA7xIe2vjG4HcMYh3fC7jvZYCcySH1GHPZYMartPHNCnkIt8dUqn+pNRJEqN+eqht6MtVPTucvJXQ64DGmTdsGfWVfCu3HzOOwtY1oPL9466L3qJ7PqrA=="}} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:46:32.275025 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.quota [None req-731f1347-0ec1-4333-bea0-ce7dcbc379d6 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Getting quotas for project a15ae9d15a64468f80628ed51c2e42d6. Resources: {'key_pairs'} {{(pid=124933) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 15:46:32.278798 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.quota [None req-731f1347-0ec1-4333-bea0-ce7dcbc379d6 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Getting quotas for user 472049224bbf48699b8a9410ec61aa9e and project a15ae9d15a64468f80628ed51c2e42d6. Resources: {'key_pairs'} {{(pid=124933) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 15:46:32.363719 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-731f1347-0ec1-4333-bea0-ce7dcbc379d6 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.106867 May 23 15:46:32.364250 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 264/551] 10.222.0.64 () {60 vars in 1158 bytes} [Mon May 23 15:46:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:46:32.572172 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-13f1ac76-ea9d-479c-9f5f-80c9d7334f2f tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:32.572869 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-13f1ac76-ea9d-479c-9f5f-80c9d7334f2f tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 53a161fc-db24-4861-8e60-b1e29465366e] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:32.579764 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-13f1ac76-ea9d-479c-9f5f-80c9d7334f2f tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:32.580215 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-13f1ac76-ea9d-479c-9f5f-80c9d7334f2f tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:32.580973 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-13f1ac76-ea9d-479c-9f5f-80c9d7334f2f tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:32.581439 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-13f1ac76-ea9d-479c-9f5f-80c9d7334f2f tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:32.742360 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-13f1ac76-ea9d-479c-9f5f-80c9d7334f2f tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:46:32.751376 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-13f1ac76-ea9d-479c-9f5f-80c9d7334f2f tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e" status: 200 len: 1364 microversion: 2.1 time: 0.183633 May 23 15:46:32.751950 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 288/552] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:32 2022] GET /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e => generated 1364 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:46:33.768839 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-cd0bc5df-9410-490f-92fe-2acf0034d07e tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:33.769529 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-cd0bc5df-9410-490f-92fe-2acf0034d07e tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 53a161fc-db24-4861-8e60-b1e29465366e] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:33.776343 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-cd0bc5df-9410-490f-92fe-2acf0034d07e tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:33.776794 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-cd0bc5df-9410-490f-92fe-2acf0034d07e tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:33.777605 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-cd0bc5df-9410-490f-92fe-2acf0034d07e tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:33.778075 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-cd0bc5df-9410-490f-92fe-2acf0034d07e tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:33.963941 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-cd0bc5df-9410-490f-92fe-2acf0034d07e tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:46:33.971766 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-cd0bc5df-9410-490f-92fe-2acf0034d07e tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e" status: 200 len: 1364 microversion: 2.1 time: 0.207846 May 23 15:46:33.972405 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 265/553] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:33 2022] GET /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e => generated 1364 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:46:34.594316 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-ec31723f-d04f-482f-b038-fe722058dfa0 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-283158029", "imageRef": "a5c8503f-3733-426f-8a5b-c7c9358e4a45", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6b67b25e-d689-4151-bafc-c9d67faaca84"}], "security_groups": [{"name": "tempest-securitygroup--412916018"}], "key_name": "tempest-keypair-1447800045", "user_data": "}} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:46:34.691357 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.network.neutron [None req-ec31723f-d04f-482f-b038-fe722058dfa0 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] validate_networks() for [('6b67b25e-d689-4151-bafc-c9d67faaca84', None, None, None, None, None)] {{(pid=124934) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 15:46:34.988379 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-d9839166-59d3-4ccd-bedb-7c13a0bfc33a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:34.989575 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-d9839166-59d3-4ccd-bedb-7c13a0bfc33a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 53a161fc-db24-4861-8e60-b1e29465366e] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:34.996711 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-d9839166-59d3-4ccd-bedb-7c13a0bfc33a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:34.997469 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-d9839166-59d3-4ccd-bedb-7c13a0bfc33a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:34.998353 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-d9839166-59d3-4ccd-bedb-7c13a0bfc33a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:34.998894 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-d9839166-59d3-4ccd-bedb-7c13a0bfc33a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:35.175432 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.virt.hardware [None req-ec31723f-d04f-482f-b038-fe722058dfa0 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Flavor limits 0:0:0 {{(pid=124934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 15:46:35.176139 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.virt.hardware [None req-ec31723f-d04f-482f-b038-fe722058dfa0 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Image limits 0:0:0 {{(pid=124934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 15:46:35.176522 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.virt.hardware [None req-ec31723f-d04f-482f-b038-fe722058dfa0 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Flavor pref 0:0:0 {{(pid=124934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 15:46:35.176937 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.virt.hardware [None req-ec31723f-d04f-482f-b038-fe722058dfa0 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Image pref 0:0:0 {{(pid=124934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 15:46:35.177555 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.virt.hardware [None req-ec31723f-d04f-482f-b038-fe722058dfa0 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 15:46:35.186723 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ec31723f-d04f-482f-b038-fe722058dfa0 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:35.190623 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ec31723f-d04f-482f-b038-fe722058dfa0 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:35.190623 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ec31723f-d04f-482f-b038-fe722058dfa0 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:35.190623 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ec31723f-d04f-482f-b038-fe722058dfa0 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:35.204040 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-d9839166-59d3-4ccd-bedb-7c13a0bfc33a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:46:35.208106 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.quota [None req-ec31723f-d04f-482f-b038-fe722058dfa0 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Getting quotas for project a15ae9d15a64468f80628ed51c2e42d6. Resources: {'ram', 'instances', 'cores'} {{(pid=124934) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 15:46:35.214126 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-d9839166-59d3-4ccd-bedb-7c13a0bfc33a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e" status: 200 len: 1364 microversion: 2.1 time: 0.227973 May 23 15:46:35.214246 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.quota [None req-ec31723f-d04f-482f-b038-fe722058dfa0 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Getting quotas for user 472049224bbf48699b8a9410ec61aa9e and project a15ae9d15a64468f80628ed51c2e42d6. Resources: {'ram', 'instances', 'cores'} {{(pid=124934) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 15:46:35.214331 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 266/554] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:34 2022] GET /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e => generated 1364 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:46:35.221831 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:35.224399 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-ec31723f-d04f-482f-b038-fe722058dfa0 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Going to run 1 instances... {{(pid=124934) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 15:46:35.226704 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-ec31723f-d04f-482f-b038-fe722058dfa0 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 8393c1a9-60d1-4b54-947d-3ef1a2e56845] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5c8503f-3733-426f-8a5b-c7c9358e4a45',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124934) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 15:46:35.335501 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-ec31723f-d04f-482f-b038-fe722058dfa0 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.746463 May 23 15:46:35.336308 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 289/555] 10.222.0.64 () {60 vars in 1146 bytes} [Mon May 23 15:46:34 2022] POST /compute/v2.1/servers => generated 401 bytes in 748 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 15:46:35.353706 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-fd89d912-3943-4f9b-bc92-9004649587b8 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:35.354361 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-fd89d912-3943-4f9b-bc92-9004649587b8 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 8393c1a9-60d1-4b54-947d-3ef1a2e56845] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:35.416529 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-fd89d912-3943-4f9b-bc92-9004649587b8 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:46:35.423755 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-fd89d912-3943-4f9b-bc92-9004649587b8 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845" status: 200 len: 1241 microversion: 2.1 time: 0.074987 May 23 15:46:35.424314 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 267/556] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:35 2022] GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845 => generated 1241 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:46:36.231188 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-8041bfb4-cd55-473e-9300-a1b7e8d713eb tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:36.231801 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-8041bfb4-cd55-473e-9300-a1b7e8d713eb tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 53a161fc-db24-4861-8e60-b1e29465366e] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:36.238777 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-8041bfb4-cd55-473e-9300-a1b7e8d713eb tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:36.239229 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-8041bfb4-cd55-473e-9300-a1b7e8d713eb tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:36.240057 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-8041bfb4-cd55-473e-9300-a1b7e8d713eb tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:36.240500 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-8041bfb4-cd55-473e-9300-a1b7e8d713eb tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:36.370497 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-8041bfb4-cd55-473e-9300-a1b7e8d713eb tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:46:36.379059 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-8041bfb4-cd55-473e-9300-a1b7e8d713eb tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e" status: 200 len: 1364 microversion: 2.1 time: 0.152135 May 23 15:46:36.379614 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 290/557] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:36 2022] GET /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:46:36.440384 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-b9e69a53-c889-4719-b792-9b95bec61afb tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:36.445814 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-b9e69a53-c889-4719-b792-9b95bec61afb tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 8393c1a9-60d1-4b54-947d-3ef1a2e56845] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:36.448122 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b9e69a53-c889-4719-b792-9b95bec61afb tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:36.448576 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b9e69a53-c889-4719-b792-9b95bec61afb tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:36.449433 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b9e69a53-c889-4719-b792-9b95bec61afb tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:36.449873 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b9e69a53-c889-4719-b792-9b95bec61afb tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:36.511464 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-b9e69a53-c889-4719-b792-9b95bec61afb tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:46:36.518963 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-b9e69a53-c889-4719-b792-9b95bec61afb tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845" status: 200 len: 1237 microversion: 2.1 time: 0.083136 May 23 15:46:36.519579 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 268/558] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:36 2022] GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845 => generated 1237 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:46:36.877555 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-4aead0d3-3d41-4d81-a5db-0ac1dc9ed7e5 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:36.878046 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-4aead0d3-3d41-4d81-a5db-0ac1dc9ed7e5 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 15c3a3b9-3d55-44c3-8627-ba397c1f069d] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:36.884014 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4aead0d3-3d41-4d81-a5db-0ac1dc9ed7e5 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:36.884462 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4aead0d3-3d41-4d81-a5db-0ac1dc9ed7e5 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:36.885266 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4aead0d3-3d41-4d81-a5db-0ac1dc9ed7e5 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:36.885730 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4aead0d3-3d41-4d81-a5db-0ac1dc9ed7e5 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:36.964260 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.objects.instance [None req-4aead0d3-3d41-4d81-a5db-0ac1dc9ed7e5 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lazy-loading 'services' on Instance uuid 15c3a3b9-3d55-44c3-8627-ba397c1f069d {{(pid=124934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 15:46:37.151990 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [req-96e1382b-d5d9-4173-8c17-b89b48fcc6fc req-64e22355-2d89-4289-8485-d5a99b67d492 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53a161fc-db24-4861-8e60-b1e29465366e", "name": "network-vif-plugged", "status": "completed", "tag": "75239bc1-69c6-438c-af43-de4ccb9f0f6d"}]} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:46:37.161207 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-96e1382b-d5d9-4173-8c17-b89b48fcc6fc req-64e22355-2d89-4289-8485-d5a99b67d492 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:37.164028 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-96e1382b-d5d9-4173-8c17-b89b48fcc6fc req-64e22355-2d89-4289-8485-d5a99b67d492 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:37.172796 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.compute.server_external_events [req-96e1382b-d5d9-4173-8c17-b89b48fcc6fc req-64e22355-2d89-4289-8485-d5a99b67d492 service nova] Creating event network-vif-plugged:75239bc1-69c6-438c-af43-de4ccb9f0f6d for instance 53a161fc-db24-4861-8e60-b1e29465366e on hv-cinder-84067 May 23 15:46:37.178350 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [req-96e1382b-d5d9-4173-8c17-b89b48fcc6fc req-64e22355-2d89-4289-8485-d5a99b67d492 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029966 May 23 15:46:37.179126 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 269/559] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:46:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:46:37.218406 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-4aead0d3-3d41-4d81-a5db-0ac1dc9ed7e5 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "DELETE /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d/os-volume_attachments/7f22b416-6cbb-4e72-b5f9-e986120e2381" status: 202 len: 0 microversion: 2.1 time: 0.344489 May 23 15:46:37.219262 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 291/560] 10.222.0.64 () {58 vars in 1415 bytes} [Mon May 23 15:46:36 2022] DELETE /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d/os-volume_attachments/7f22b416-6cbb-4e72-b5f9-e986120e2381 => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 15:46:37.228074 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-2db95f92-143e-458e-99df-f19c2d920ff5 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:37.229282 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-2db95f92-143e-458e-99df-f19c2d920ff5 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 15c3a3b9-3d55-44c3-8627-ba397c1f069d] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:37.237385 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-2db95f92-143e-458e-99df-f19c2d920ff5 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:37.237818 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-2db95f92-143e-458e-99df-f19c2d920ff5 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:37.238640 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-2db95f92-143e-458e-99df-f19c2d920ff5 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:37.239063 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-2db95f92-143e-458e-99df-f19c2d920ff5 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:37.271563 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-2db95f92-143e-458e-99df-f19c2d920ff5 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047590 May 23 15:46:37.272429 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 270/561] 10.222.0.64 () {58 vars in 1301 bytes} [Mon May 23 15:46:37 2022] GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:46:37.398115 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-c09efced-bbdb-454b-a736-28784e7d69ce tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:37.399143 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-c09efced-bbdb-454b-a736-28784e7d69ce tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 53a161fc-db24-4861-8e60-b1e29465366e] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:37.406893 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-c09efced-bbdb-454b-a736-28784e7d69ce tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:37.407347 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-c09efced-bbdb-454b-a736-28784e7d69ce tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:37.408126 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-c09efced-bbdb-454b-a736-28784e7d69ce tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:37.408562 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-c09efced-bbdb-454b-a736-28784e7d69ce tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:37.535799 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-5b423a4e-3a06-4409-adf2-ca4395fbfbbe tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:37.536415 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-5b423a4e-3a06-4409-adf2-ca4395fbfbbe tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 8393c1a9-60d1-4b54-947d-3ef1a2e56845] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:37.542980 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-5b423a4e-3a06-4409-adf2-ca4395fbfbbe tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:37.543476 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-5b423a4e-3a06-4409-adf2-ca4395fbfbbe tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:37.544253 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-5b423a4e-3a06-4409-adf2-ca4395fbfbbe tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:37.544874 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-5b423a4e-3a06-4409-adf2-ca4395fbfbbe tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:37.545478 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-c09efced-bbdb-454b-a736-28784e7d69ce tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:46:37.555762 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-c09efced-bbdb-454b-a736-28784e7d69ce tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e" status: 200 len: 1364 microversion: 2.1 time: 0.163213 May 23 15:46:37.557185 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 292/562] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:37 2022] GET /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:46:37.609897 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-5b423a4e-3a06-4409-adf2-ca4395fbfbbe tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:46:37.617220 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-5b423a4e-3a06-4409-adf2-ca4395fbfbbe tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845" status: 200 len: 1311 microversion: 2.1 time: 0.085292 May 23 15:46:37.617778 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 271/563] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:37 2022] GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845 => generated 1311 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:46:38.295020 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-c98e62db-b6d5-430a-a20e-0a2bc78a593f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:38.297912 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-c98e62db-b6d5-430a-a20e-0a2bc78a593f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 15c3a3b9-3d55-44c3-8627-ba397c1f069d] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:38.304796 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-c98e62db-b6d5-430a-a20e-0a2bc78a593f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:38.305277 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-c98e62db-b6d5-430a-a20e-0a2bc78a593f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:38.306069 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-c98e62db-b6d5-430a-a20e-0a2bc78a593f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:38.306584 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-c98e62db-b6d5-430a-a20e-0a2bc78a593f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:38.338167 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-c98e62db-b6d5-430a-a20e-0a2bc78a593f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052751 May 23 15:46:38.338884 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 293/564] 10.222.0.64 () {58 vars in 1301 bytes} [Mon May 23 15:46:38 2022] GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:46:38.573413 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-0ae63eef-fa5b-4cf1-b2f4-b3f0af302172 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:38.574027 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-0ae63eef-fa5b-4cf1-b2f4-b3f0af302172 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 53a161fc-db24-4861-8e60-b1e29465366e] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:38.581458 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-0ae63eef-fa5b-4cf1-b2f4-b3f0af302172 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:38.581922 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-0ae63eef-fa5b-4cf1-b2f4-b3f0af302172 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:38.582710 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-0ae63eef-fa5b-4cf1-b2f4-b3f0af302172 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:38.583154 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-0ae63eef-fa5b-4cf1-b2f4-b3f0af302172 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:38.635353 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-2581eab4-c0e5-48b1-838b-1b028c9eb042 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:38.636081 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-2581eab4-c0e5-48b1-838b-1b028c9eb042 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 8393c1a9-60d1-4b54-947d-3ef1a2e56845] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:38.644397 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2581eab4-c0e5-48b1-838b-1b028c9eb042 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:38.645508 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2581eab4-c0e5-48b1-838b-1b028c9eb042 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:38.646502 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2581eab4-c0e5-48b1-838b-1b028c9eb042 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:38.646949 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2581eab4-c0e5-48b1-838b-1b028c9eb042 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:38.768552 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-0ae63eef-fa5b-4cf1-b2f4-b3f0af302172 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:46:38.776537 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-0ae63eef-fa5b-4cf1-b2f4-b3f0af302172 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e" status: 200 len: 1364 microversion: 2.1 time: 0.207007 May 23 15:46:38.782219 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 272/565] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:38 2022] GET /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e => generated 1364 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:46:38.817308 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-2581eab4-c0e5-48b1-838b-1b028c9eb042 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:46:38.824871 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-2581eab4-c0e5-48b1-838b-1b028c9eb042 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845" status: 200 len: 1366 microversion: 2.1 time: 0.193583 May 23 15:46:38.825656 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 294/566] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:38 2022] GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845 => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:46:39.350063 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-b295ebd8-e85d-4bc5-b8e4-07a32469b73a tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:39.350991 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-b295ebd8-e85d-4bc5-b8e4-07a32469b73a tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 15c3a3b9-3d55-44c3-8627-ba397c1f069d] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:39.357006 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b295ebd8-e85d-4bc5-b8e4-07a32469b73a tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:39.357480 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b295ebd8-e85d-4bc5-b8e4-07a32469b73a tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:39.358768 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b295ebd8-e85d-4bc5-b8e4-07a32469b73a tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:39.359876 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b295ebd8-e85d-4bc5-b8e4-07a32469b73a tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:39.392089 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-b295ebd8-e85d-4bc5-b8e4-07a32469b73a tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045899 May 23 15:46:39.397372 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 273/567] 10.222.0.64 () {58 vars in 1301 bytes} [Mon May 23 15:46:39 2022] GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 15:46:39.464031 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-136462a0-dbc6-4676-9a3e-0f5a1ab32e9d tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:39.464541 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-136462a0-dbc6-4676-9a3e-0f5a1ab32e9d tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 15c3a3b9-3d55-44c3-8627-ba397c1f069d] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:39.471129 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-136462a0-dbc6-4676-9a3e-0f5a1ab32e9d tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:39.471594 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-136462a0-dbc6-4676-9a3e-0f5a1ab32e9d tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:39.472444 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-136462a0-dbc6-4676-9a3e-0f5a1ab32e9d tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:39.473250 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-136462a0-dbc6-4676-9a3e-0f5a1ab32e9d tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:39.503141 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-136462a0-dbc6-4676-9a3e-0f5a1ab32e9d tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 15c3a3b9-3d55-44c3-8627-ba397c1f069d] Going to try to terminate instance {{(pid=124934) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 15:46:39.744282 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [req-4dd08f4e-2dcf-4cb1-af2f-a0f5881bf135 req-a63b342d-1eb2-4e36-b6de-c8f89becdcc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8393c1a9-60d1-4b54-947d-3ef1a2e56845", "tag": "ab319228-d2e4-408a-a8f8-6e3febb2286b"}]} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:46:39.752698 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-4dd08f4e-2dcf-4cb1-af2f-a0f5881bf135 req-a63b342d-1eb2-4e36-b6de-c8f89becdcc9 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:39.753846 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-4dd08f4e-2dcf-4cb1-af2f-a0f5881bf135 req-a63b342d-1eb2-4e36-b6de-c8f89becdcc9 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:39.770604 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.compute.server_external_events [req-4dd08f4e-2dcf-4cb1-af2f-a0f5881bf135 req-a63b342d-1eb2-4e36-b6de-c8f89becdcc9 service nova] Creating event network-changed:ab319228-d2e4-408a-a8f8-6e3febb2286b for instance 8393c1a9-60d1-4b54-947d-3ef1a2e56845 on hv-cinder-84067 May 23 15:46:39.776145 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [req-4dd08f4e-2dcf-4cb1-af2f-a0f5881bf135 req-a63b342d-1eb2-4e36-b6de-c8f89becdcc9 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035578 May 23 15:46:39.776763 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 274/568] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:46:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:46:39.793529 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-2215e3e8-8be9-4a96-9825-fd18dec3da11 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:39.794251 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-2215e3e8-8be9-4a96-9825-fd18dec3da11 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 53a161fc-db24-4861-8e60-b1e29465366e] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:39.801840 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-2215e3e8-8be9-4a96-9825-fd18dec3da11 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:39.802290 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-2215e3e8-8be9-4a96-9825-fd18dec3da11 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:39.803056 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-2215e3e8-8be9-4a96-9825-fd18dec3da11 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:39.803487 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-2215e3e8-8be9-4a96-9825-fd18dec3da11 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:39.887473 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-136462a0-dbc6-4676-9a3e-0f5a1ab32e9d tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "DELETE /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d" status: 204 len: 0 microversion: 2.1 time: 0.427065 May 23 15:46:39.891575 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 295/569] 10.222.0.64 () {58 vars in 1238 bytes} [Mon May 23 15:46:39 2022] DELETE /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d => generated 0 bytes in 432 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 15:46:39.898264 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-21d20b99-dc1a-46d4-8f4d-590b3f600425 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:39.899157 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-21d20b99-dc1a-46d4-8f4d-590b3f600425 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 8393c1a9-60d1-4b54-947d-3ef1a2e56845] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:39.906839 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-21d20b99-dc1a-46d4-8f4d-590b3f600425 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:39.907535 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-21d20b99-dc1a-46d4-8f4d-590b3f600425 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:39.908685 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-21d20b99-dc1a-46d4-8f4d-590b3f600425 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:39.909421 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-21d20b99-dc1a-46d4-8f4d-590b3f600425 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:40.038719 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-2215e3e8-8be9-4a96-9825-fd18dec3da11 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:46:40.046540 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-2215e3e8-8be9-4a96-9825-fd18dec3da11 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e" status: 200 len: 1550 microversion: 2.1 time: 0.257502 May 23 15:46:40.052762 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 275/570] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:39 2022] GET /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e => generated 1550 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:46:40.052762 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-553e9299-da1c-4b05-8186-6e6a21f75afc tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:40.052762 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-553e9299-da1c-4b05-8186-6e6a21f75afc tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 15c3a3b9-3d55-44c3-8627-ba397c1f069d] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:40.058758 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-553e9299-da1c-4b05-8186-6e6a21f75afc tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:40.059207 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-553e9299-da1c-4b05-8186-6e6a21f75afc tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:40.059975 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-553e9299-da1c-4b05-8186-6e6a21f75afc tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:40.060409 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-553e9299-da1c-4b05-8186-6e6a21f75afc tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:40.075218 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-21d20b99-dc1a-46d4-8f4d-590b3f600425 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:46:40.084391 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-21d20b99-dc1a-46d4-8f4d-590b3f600425 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845" status: 200 len: 1366 microversion: 2.1 time: 0.191309 May 23 15:46:40.084956 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 296/571] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:39 2022] GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845 => generated 1366 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:46:40.089710 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-791739f4-6b1a-4963-8739-a6f4653b31ac tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:40.090202 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-791739f4-6b1a-4963-8739-a6f4653b31ac tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 53a161fc-db24-4861-8e60-b1e29465366e] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:40.097400 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-791739f4-6b1a-4963-8739-a6f4653b31ac tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:40.097852 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-791739f4-6b1a-4963-8739-a6f4653b31ac tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:40.098617 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-791739f4-6b1a-4963-8739-a6f4653b31ac tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:40.099049 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-791739f4-6b1a-4963-8739-a6f4653b31ac tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:40.203943 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-791739f4-6b1a-4963-8739-a6f4653b31ac tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.117887 May 23 15:46:40.204532 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 297/572] 10.222.0.64 () {58 vars in 1274 bytes} [Mon May 23 15:46:40 2022] GET /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e/os-interface => generated 285 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:46:40.232682 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-553e9299-da1c-4b05-8186-6e6a21f75afc tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:46:40.240320 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-553e9299-da1c-4b05-8186-6e6a21f75afc tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d" status: 200 len: 1686 microversion: 2.1 time: 0.191901 May 23 15:46:40.240881 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 276/573] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:40 2022] GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d => generated 1686 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:46:41.102734 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-3a014086-5190-44d0-91b9-e32d503771b1 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:41.103342 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-3a014086-5190-44d0-91b9-e32d503771b1 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 8393c1a9-60d1-4b54-947d-3ef1a2e56845] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:41.109996 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3a014086-5190-44d0-91b9-e32d503771b1 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:41.110446 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3a014086-5190-44d0-91b9-e32d503771b1 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:41.111207 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3a014086-5190-44d0-91b9-e32d503771b1 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:41.111642 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3a014086-5190-44d0-91b9-e32d503771b1 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:41.239443 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-3a014086-5190-44d0-91b9-e32d503771b1 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:46:41.246819 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-3a014086-5190-44d0-91b9-e32d503771b1 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845" status: 200 len: 1366 microversion: 2.1 time: 0.147974 May 23 15:46:41.247609 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 298/574] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:41 2022] GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:46:41.257710 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-ecbfef6a-848b-4aaa-a819-4f6e9a0e96ed tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:41.258333 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-ecbfef6a-848b-4aaa-a819-4f6e9a0e96ed tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 15c3a3b9-3d55-44c3-8627-ba397c1f069d] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:41.261845 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:41.266671 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ecbfef6a-848b-4aaa-a819-4f6e9a0e96ed tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:41.267123 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ecbfef6a-848b-4aaa-a819-4f6e9a0e96ed tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:41.267897 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ecbfef6a-848b-4aaa-a819-4f6e9a0e96ed tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:41.268336 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ecbfef6a-848b-4aaa-a819-4f6e9a0e96ed tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:41.405247 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-ecbfef6a-848b-4aaa-a819-4f6e9a0e96ed tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:46:41.412990 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-ecbfef6a-848b-4aaa-a819-4f6e9a0e96ed tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d" status: 200 len: 1686 microversion: 2.1 time: 0.159100 May 23 15:46:41.421753 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 277/575] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:41 2022] GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d => generated 1686 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:46:41.791252 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [req-a484697f-6f81-439d-b121-a3d6a94e21c2 req-3a4cc05a-6091-4926-9aa0-03f0710aaa56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53a161fc-db24-4861-8e60-b1e29465366e", "tag": "75239bc1-69c6-438c-af43-de4ccb9f0f6d"}]} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:46:41.800990 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-a484697f-6f81-439d-b121-a3d6a94e21c2 req-3a4cc05a-6091-4926-9aa0-03f0710aaa56 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:41.801465 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-a484697f-6f81-439d-b121-a3d6a94e21c2 req-3a4cc05a-6091-4926-9aa0-03f0710aaa56 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:41.812661 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.compute.server_external_events [req-a484697f-6f81-439d-b121-a3d6a94e21c2 req-3a4cc05a-6091-4926-9aa0-03f0710aaa56 service nova] Creating event network-changed:75239bc1-69c6-438c-af43-de4ccb9f0f6d for instance 53a161fc-db24-4861-8e60-b1e29465366e on hv-cinder-84067 May 23 15:46:41.817474 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [req-a484697f-6f81-439d-b121-a3d6a94e21c2 req-3a4cc05a-6091-4926-9aa0-03f0710aaa56 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029961 May 23 15:46:41.818046 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 299/576] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:46:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:46:42.264887 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-a11cd425-259a-412b-a081-0dcc505fec2d tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:42.265756 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-a11cd425-259a-412b-a081-0dcc505fec2d tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 8393c1a9-60d1-4b54-947d-3ef1a2e56845] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:42.272442 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a11cd425-259a-412b-a081-0dcc505fec2d tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:42.272897 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a11cd425-259a-412b-a081-0dcc505fec2d tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:42.273707 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a11cd425-259a-412b-a081-0dcc505fec2d tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:42.274150 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a11cd425-259a-412b-a081-0dcc505fec2d tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:42.420983 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-a11cd425-259a-412b-a081-0dcc505fec2d tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:46:42.424679 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-a11cd425-259a-412b-a081-0dcc505fec2d tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845" status: 200 len: 1366 microversion: 2.1 time: 0.164767 May 23 15:46:42.425708 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 278/577] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:42 2022] GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:46:42.431256 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-3449a68d-fc13-4255-a69a-7eda3f69d21b tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:42.432118 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-3449a68d-fc13-4255-a69a-7eda3f69d21b tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 15c3a3b9-3d55-44c3-8627-ba397c1f069d] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:42.438346 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3449a68d-fc13-4255-a69a-7eda3f69d21b tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:42.438872 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3449a68d-fc13-4255-a69a-7eda3f69d21b tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:42.439637 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3449a68d-fc13-4255-a69a-7eda3f69d21b tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:42.440072 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3449a68d-fc13-4255-a69a-7eda3f69d21b tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:42.571232 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-3449a68d-fc13-4255-a69a-7eda3f69d21b tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:46:42.579539 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-3449a68d-fc13-4255-a69a-7eda3f69d21b tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d" status: 200 len: 1686 microversion: 2.1 time: 0.152336 May 23 15:46:42.580118 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 300/578] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:42 2022] GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d => generated 1686 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:46:43.448842 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-367b9995-9528-4af9-9a2d-6ae6cf808e23 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:43.449540 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-367b9995-9528-4af9-9a2d-6ae6cf808e23 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 8393c1a9-60d1-4b54-947d-3ef1a2e56845] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:43.457282 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-367b9995-9528-4af9-9a2d-6ae6cf808e23 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:43.457988 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-367b9995-9528-4af9-9a2d-6ae6cf808e23 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:43.458922 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-367b9995-9528-4af9-9a2d-6ae6cf808e23 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:43.459510 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-367b9995-9528-4af9-9a2d-6ae6cf808e23 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:43.464447 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_cell1:SELECT=100 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:43.597311 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-ead39a38-caf8-4e22-a536-3d414d3f8b09 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:43.598042 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-ead39a38-caf8-4e22-a536-3d414d3f8b09 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 15c3a3b9-3d55-44c3-8627-ba397c1f069d] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:43.604666 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ead39a38-caf8-4e22-a536-3d414d3f8b09 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:43.605489 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ead39a38-caf8-4e22-a536-3d414d3f8b09 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:43.606510 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ead39a38-caf8-4e22-a536-3d414d3f8b09 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:43.607053 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ead39a38-caf8-4e22-a536-3d414d3f8b09 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:44.018674 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-367b9995-9528-4af9-9a2d-6ae6cf808e23 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:46:44.025978 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-367b9995-9528-4af9-9a2d-6ae6cf808e23 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845" status: 200 len: 1366 microversion: 2.1 time: 0.587738 May 23 15:46:44.026537 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 279/579] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:43 2022] GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845 => generated 1366 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:46:44.151790 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-ead39a38-caf8-4e22-a536-3d414d3f8b09 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:46:44.159878 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-ead39a38-caf8-4e22-a536-3d414d3f8b09 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d" status: 200 len: 1686 microversion: 2.1 time: 0.567905 May 23 15:46:44.162064 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 301/580] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:43 2022] GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d => generated 1686 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:46:44.834359 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [req-ee63b524-e87c-4589-8fb0-adf68987e930 req-844eb3ca-70e3-41a6-9f81-d965ef71a95c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15c3a3b9-3d55-44c3-8627-ba397c1f069d", "name": "network-vif-deleted", "tag": "f835d7e4-2023-42a3-91c1-27e29436c365"}]} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:46:44.844407 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-ee63b524-e87c-4589-8fb0-adf68987e930 req-844eb3ca-70e3-41a6-9f81-d965ef71a95c service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:44.845394 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-ee63b524-e87c-4589-8fb0-adf68987e930 req-844eb3ca-70e3-41a6-9f81-d965ef71a95c service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:44.856787 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.compute.server_external_events [req-ee63b524-e87c-4589-8fb0-adf68987e930 req-844eb3ca-70e3-41a6-9f81-d965ef71a95c service nova] Creating event network-vif-deleted:f835d7e4-2023-42a3-91c1-27e29436c365 for instance 15c3a3b9-3d55-44c3-8627-ba397c1f069d on hv-cinder-84067 May 23 15:46:44.865855 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [req-ee63b524-e87c-4589-8fb0-adf68987e930 req-844eb3ca-70e3-41a6-9f81-d965ef71a95c service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032846 May 23 15:46:44.865855 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 280/581] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:46:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:46:45.042488 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-daa16e3e-23ac-4199-a1a1-af7108b924cc tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:45.043162 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-daa16e3e-23ac-4199-a1a1-af7108b924cc tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 8393c1a9-60d1-4b54-947d-3ef1a2e56845] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:45.050056 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-daa16e3e-23ac-4199-a1a1-af7108b924cc tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:45.050509 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-daa16e3e-23ac-4199-a1a1-af7108b924cc tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:45.051323 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-daa16e3e-23ac-4199-a1a1-af7108b924cc tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:45.051946 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-daa16e3e-23ac-4199-a1a1-af7108b924cc tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:45.178409 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-76819859-be24-4746-a729-c0e81dbaaa3d tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:45.181862 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-76819859-be24-4746-a729-c0e81dbaaa3d tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 15c3a3b9-3d55-44c3-8627-ba397c1f069d] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:45.189998 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-daa16e3e-23ac-4199-a1a1-af7108b924cc tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:46:45.191180 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-76819859-be24-4746-a729-c0e81dbaaa3d tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:45.191828 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-76819859-be24-4746-a729-c0e81dbaaa3d tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:45.192772 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-76819859-be24-4746-a729-c0e81dbaaa3d tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:45.193395 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-76819859-be24-4746-a729-c0e81dbaaa3d tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:45.194644 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:45.199819 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-daa16e3e-23ac-4199-a1a1-af7108b924cc tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845" status: 200 len: 1366 microversion: 2.1 time: 0.161149 May 23 15:46:45.200489 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 302/582] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:45 2022] GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:46:45.229484 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-76819859-be24-4746-a729-c0e81dbaaa3d tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:45.229951 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-76819859-be24-4746-a729-c0e81dbaaa3d tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:45.230396 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.objects.instance [None req-76819859-be24-4746-a729-c0e81dbaaa3d tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lazy-loading 'fault' on Instance uuid 15c3a3b9-3d55-44c3-8627-ba397c1f069d {{(pid=124933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 15:46:45.272921 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-76819859-be24-4746-a729-c0e81dbaaa3d tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:46:45.281453 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-76819859-be24-4746-a729-c0e81dbaaa3d tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d" status: 200 len: 1336 microversion: 2.1 time: 0.106763 May 23 15:46:45.281787 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 281/583] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:45 2022] GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d => generated 1336 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:46:45.891881 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-9ca6a258-d734-4828-aa47-1f3fa8445bb1 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:46:45.892516 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-9ca6a258-d734-4828-aa47-1f3fa8445bb1 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] [instance: dd66096c-0b64-4a26-bdec-1b1a46310cfb] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:45.894380 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_cell0:SELECT=4 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:45.895046 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_cell0:SELECT=16 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:45.900194 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-9ca6a258-d734-4828-aa47-1f3fa8445bb1 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:45.900637 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-9ca6a258-d734-4828-aa47-1f3fa8445bb1 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:45.901430 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-9ca6a258-d734-4828-aa47-1f3fa8445bb1 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:45.901863 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-9ca6a258-d734-4828-aa47-1f3fa8445bb1 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:45.926569 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.objects.instance [None req-9ca6a258-d734-4828-aa47-1f3fa8445bb1 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lazy-loading 'flavor' on Instance uuid dd66096c-0b64-4a26-bdec-1b1a46310cfb {{(pid=124934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 15:46:46.217297 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-dc529b52-293d-4456-89ad-5ba60af1f4af tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:46.218467 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-dc529b52-293d-4456-89ad-5ba60af1f4af tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 8393c1a9-60d1-4b54-947d-3ef1a2e56845] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:46.220387 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_cell0:SELECT=8 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:46.225723 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-dc529b52-293d-4456-89ad-5ba60af1f4af tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:46.226171 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-dc529b52-293d-4456-89ad-5ba60af1f4af tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:46.226927 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-dc529b52-293d-4456-89ad-5ba60af1f4af tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:46.227362 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-dc529b52-293d-4456-89ad-5ba60af1f4af tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:46.247293 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-9ca6a258-d734-4828-aa47-1f3fa8445bb1 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] 10.222.0.64 "POST /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb/action" status: 202 len: 0 microversion: 2.1 time: 0.360133 May 23 15:46:46.248119 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 303/584] 10.222.0.64 () {60 vars in 1277 bytes} [Mon May 23 15:46:45 2022] POST /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb/action => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 15:46:46.264026 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-5a01983d-74b6-463f-a9a5-49a9be8c1abb tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:46.265455 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-5a01983d-74b6-463f-a9a5-49a9be8c1abb tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] [instance: dd66096c-0b64-4a26-bdec-1b1a46310cfb] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:46.271855 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5a01983d-74b6-463f-a9a5-49a9be8c1abb tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:46.272915 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5a01983d-74b6-463f-a9a5-49a9be8c1abb tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:46.273232 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5a01983d-74b6-463f-a9a5-49a9be8c1abb tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:46.273671 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5a01983d-74b6-463f-a9a5-49a9be8c1abb tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:46.423796 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-dc529b52-293d-4456-89ad-5ba60af1f4af tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:46:46.431618 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-dc529b52-293d-4456-89ad-5ba60af1f4af tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845" status: 200 len: 1366 microversion: 2.1 time: 0.217979 May 23 15:46:46.440967 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 282/585] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:46 2022] GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845 => generated 1366 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:46:46.453276 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-5a01983d-74b6-463f-a9a5-49a9be8c1abb tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b983c0a2a124ac3aa3403e0777612f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0860b3d072246d49cd43a900351d571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:46:46.461794 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-5a01983d-74b6-463f-a9a5-49a9be8c1abb tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] 10.222.0.64 "GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb" status: 200 len: 1567 microversion: 2.1 time: 0.201471 May 23 15:46:46.462067 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 304/586] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:46 2022] GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb => generated 1567 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:46:46.503655 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-faf0a742-87b9-4f25-aeec-3b0af44edea2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:46.504402 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-faf0a742-87b9-4f25-aeec-3b0af44edea2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 15c3a3b9-3d55-44c3-8627-ba397c1f069d] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:46.510641 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-faf0a742-87b9-4f25-aeec-3b0af44edea2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:46.511095 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-faf0a742-87b9-4f25-aeec-3b0af44edea2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:46.513558 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-faf0a742-87b9-4f25-aeec-3b0af44edea2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:46.513558 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-faf0a742-87b9-4f25-aeec-3b0af44edea2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:46.525387 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.wsgi [None req-faf0a742-87b9-4f25-aeec-3b0af44edea2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] HTTP exception thrown: Instance 15c3a3b9-3d55-44c3-8627-ba397c1f069d could not be found. May 23 15:46:46.527040 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-faf0a742-87b9-4f25-aeec-3b0af44edea2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Request method failure captured: May 23 15:46:46.527040 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: request: GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d HTTP/1.1 May 23 15:46:46.527040 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Accept: application/json May 23 15:46:46.527040 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Accept-Encoding: identity May 23 15:46:46.527040 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Connection: close May 23 15:46:46.527040 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Content-Length: 0 May 23 15:46:46.527040 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Content-Type: application/json May 23 15:46:46.527040 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Host: 10.222.0.64 May 23 15:46:46.527040 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Openstack-System-Scope: None May 23 15:46:46.527040 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: User-Agent: python-urllib3/1.26.9 May 23 15:46:46.527040 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Auth-Token: gAAAAABii6s54KKAZxlQBYzhx-noNW6ImMu_qK18vzcxUodmAjvvJq-5TbaxZQIihTpeBFGJg_t4VXTJRBBdNp2S6NOFiVOcgKlGDwULP0bkoXn2Lrupumn987Hv9EwEHbef7k6ahcCsqTc5NRw34uO7WRPXXMvHMUWgqgfV68m8j7DAWMdthmk May 23 15:46:46.527040 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Domain-Id: None May 23 15:46:46.527040 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Domain-Name: None May 23 15:46:46.527040 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Identity-Status: Confirmed May 23 15:46:46.527040 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Is-Admin-Project: True May 23 15:46:46.527040 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Domain-Id: default May 23 15:46:46.527040 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Domain-Name: Default May 23 15:46:46.527040 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Id: 65483f2a0c914022b38e501691095c51 May 23 15:46:46.527040 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1263770255 May 23 15:46:46.527040 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Role: reader,member May 23 15:46:46.527040 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Roles: reader,member May 23 15:46:46.528657 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/65483f2a0c914022b38e501691095c51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/65483f2a0c914022b38e501691095c51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/65483f2a0c914022b38e501691095c51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_65483f2a0c914022b38e501691095c51", "adminURL": "http://10.222.0.64:8080"}]}] May 23 15:46:46.528657 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1263770255 May 23 15:46:46.528657 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant-Id: 65483f2a0c914022b38e501691095c51 May 23 15:46:46.528657 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1263770255 May 23 15:46:46.528657 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User: tempest-ServerRescueNegativeTestJSON-1263770255-project May 23 15:46:46.528657 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Domain-Id: default May 23 15:46:46.528657 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Domain-Name: Default May 23 15:46:46.528657 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Id: a2f1d435732b4ff0a60599309c66eeb5 May 23 15:46:46.528657 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1263770255-project May 23 15:46:46.528657 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: method: > May 23 15:46:46.528657 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: exception: Instance 15c3a3b9-3d55-44c3-8627-ba397c1f069d could not be found. May 23 15:46:46.528657 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: action_args: {'id': '15c3a3b9-3d55-44c3-8627-ba397c1f069d'} May 23 15:46:46.529602 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:46:46.529602 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:46:46.529602 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:46:46.529602 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:46:46.529602 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:46:46.529602 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:46:46.529602 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:46:46.529602 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:46:46.529602 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:46:46.529602 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:46:46.529602 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15c3a3b9-3d55-44c3-8627-ba397c1f069d could not be found. May 23 15:46:46.529602 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:46:46.529602 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:46:46.529602 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:46:46.529602 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:46:46.529602 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:46:46.529602 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:46:46.529602 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:46:46.529602 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:46:46.529602 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:46:46.531652 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:46:46.531652 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 15:46:46.531652 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 15:46:46.531652 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:46:46.531652 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:46:46.531652 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:46:46.531652 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:46:46.531652 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15c3a3b9-3d55-44c3-8627-ba397c1f069d could not be found. May 23 15:46:46.531652 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:46:46.531652 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:46:46.531652 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:46:46.531652 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:46:46.531652 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:46:46.531652 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:46:46.531652 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:46:46.531652 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:46:46.531652 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15c3a3b9-3d55-44c3-8627-ba397c1f069d could not be found. May 23 15:46:46.531652 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:46:46.532912 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-faf0a742-87b9-4f25-aeec-3b0af44edea2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Returning 404 to user: Instance 15c3a3b9-3d55-44c3-8627-ba397c1f069d could not be found. {{(pid=124933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:46:46.532912 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-faf0a742-87b9-4f25-aeec-3b0af44edea2 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d" status: 404 len: 111 microversion: 2.1 time: 0.095151 May 23 15:46:46.532912 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 283/587] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:46 2022] GET /compute/v2.1/servers/15c3a3b9-3d55-44c3-8627-ba397c1f069d => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 15:46:46.537969 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-0790d3f7-20aa-4af5-9000-317b4275e7cb tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '.version_select at 0x7fab52011550>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:46.648016 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-0790d3f7-20aa-4af5-9000-317b4275e7cb tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1525748368" status: 202 len: 0 microversion: 2.1 time: 0.113799 May 23 15:46:46.648581 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 305/588] 10.222.0.64 () {58 vars in 1220 bytes} [Mon May 23 15:46:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1525748368 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 15:46:47.448095 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-81973dab-6885-4c46-81c4-2d81386fa09b tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:47.448830 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-81973dab-6885-4c46-81c4-2d81386fa09b tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 8393c1a9-60d1-4b54-947d-3ef1a2e56845] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:47.455672 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-81973dab-6885-4c46-81c4-2d81386fa09b tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:47.456129 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-81973dab-6885-4c46-81c4-2d81386fa09b tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:47.456908 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-81973dab-6885-4c46-81c4-2d81386fa09b tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:47.457408 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-81973dab-6885-4c46-81c4-2d81386fa09b tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:47.481156 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-26a2fc6e-6138-4480-95d1-66a0943bb16d tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:47.481974 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-26a2fc6e-6138-4480-95d1-66a0943bb16d tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] [instance: dd66096c-0b64-4a26-bdec-1b1a46310cfb] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:47.489566 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-26a2fc6e-6138-4480-95d1-66a0943bb16d tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:47.490149 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-26a2fc6e-6138-4480-95d1-66a0943bb16d tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:47.490919 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-26a2fc6e-6138-4480-95d1-66a0943bb16d tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:47.491527 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-26a2fc6e-6138-4480-95d1-66a0943bb16d tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:47.645244 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-81973dab-6885-4c46-81c4-2d81386fa09b tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:46:47.652561 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-81973dab-6885-4c46-81c4-2d81386fa09b tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845" status: 200 len: 1366 microversion: 2.1 time: 0.208767 May 23 15:46:47.653147 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 284/589] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:47 2022] GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845 => generated 1366 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:46:47.676187 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-26a2fc6e-6138-4480-95d1-66a0943bb16d tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b983c0a2a124ac3aa3403e0777612f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0860b3d072246d49cd43a900351d571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:46:47.684059 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-26a2fc6e-6138-4480-95d1-66a0943bb16d tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] 10.222.0.64 "GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb" status: 200 len: 1567 microversion: 2.1 time: 0.206960 May 23 15:46:47.684985 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 306/590] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:47 2022] GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb => generated 1567 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:46:48.669561 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-6a4c61b9-3d23-4520-9bf1-d123970dee5d tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:48.670089 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-6a4c61b9-3d23-4520-9bf1-d123970dee5d tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 8393c1a9-60d1-4b54-947d-3ef1a2e56845] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:48.677618 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-6a4c61b9-3d23-4520-9bf1-d123970dee5d tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:48.678070 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-6a4c61b9-3d23-4520-9bf1-d123970dee5d tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:48.678888 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-6a4c61b9-3d23-4520-9bf1-d123970dee5d tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:48.679319 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-6a4c61b9-3d23-4520-9bf1-d123970dee5d tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:48.702286 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-4e888641-de95-4552-bcd4-12c31b83d00d tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:48.703159 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-4e888641-de95-4552-bcd4-12c31b83d00d tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] [instance: dd66096c-0b64-4a26-bdec-1b1a46310cfb] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:48.709247 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4e888641-de95-4552-bcd4-12c31b83d00d tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:48.718357 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4e888641-de95-4552-bcd4-12c31b83d00d tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:48.718357 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4e888641-de95-4552-bcd4-12c31b83d00d tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:48.718357 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4e888641-de95-4552-bcd4-12c31b83d00d tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:48.863865 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-6a4c61b9-3d23-4520-9bf1-d123970dee5d tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:46:48.872053 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-6a4c61b9-3d23-4520-9bf1-d123970dee5d tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845" status: 200 len: 1366 microversion: 2.1 time: 0.206350 May 23 15:46:48.872839 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 285/591] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:48 2022] GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845 => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:46:48.895534 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-4e888641-de95-4552-bcd4-12c31b83d00d tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b983c0a2a124ac3aa3403e0777612f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0860b3d072246d49cd43a900351d571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:46:48.903077 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-4e888641-de95-4552-bcd4-12c31b83d00d tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] 10.222.0.64 "GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb" status: 200 len: 1567 microversion: 2.1 time: 0.204925 May 23 15:46:48.903648 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 307/592] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:48 2022] GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb => generated 1567 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:46:49.222757 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [req-7393a0a0-529b-42c6-84e7-47b8fc0f6159 req-76355b4b-c375-4535-a4cf-29ef500b38b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8393c1a9-60d1-4b54-947d-3ef1a2e56845", "name": "network-vif-plugged", "status": "completed", "tag": "ab319228-d2e4-408a-a8f8-6e3febb2286b"}]} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:46:49.230894 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-7393a0a0-529b-42c6-84e7-47b8fc0f6159 req-76355b4b-c375-4535-a4cf-29ef500b38b7 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:49.231339 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-7393a0a0-529b-42c6-84e7-47b8fc0f6159 req-76355b4b-c375-4535-a4cf-29ef500b38b7 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:49.242905 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.compute.server_external_events [req-7393a0a0-529b-42c6-84e7-47b8fc0f6159 req-76355b4b-c375-4535-a4cf-29ef500b38b7 service nova] Creating event network-vif-plugged:ab319228-d2e4-408a-a8f8-6e3febb2286b for instance 8393c1a9-60d1-4b54-947d-3ef1a2e56845 on hv-cinder-84067 May 23 15:46:49.247901 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [req-7393a0a0-529b-42c6-84e7-47b8fc0f6159 req-76355b4b-c375-4535-a4cf-29ef500b38b7 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030254 May 23 15:46:49.248478 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 286/593] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:46:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:46:49.888577 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-1a7e74a7-bdaf-433e-959e-f29abdbb4441 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:49.889213 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-1a7e74a7-bdaf-433e-959e-f29abdbb4441 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 8393c1a9-60d1-4b54-947d-3ef1a2e56845] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:49.895834 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-1a7e74a7-bdaf-433e-959e-f29abdbb4441 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:49.896290 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-1a7e74a7-bdaf-433e-959e-f29abdbb4441 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:49.897117 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-1a7e74a7-bdaf-433e-959e-f29abdbb4441 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:49.897531 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-1a7e74a7-bdaf-433e-959e-f29abdbb4441 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:49.921281 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-9b4d6594-dc79-4c59-8d53-c04b964ab506 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:49.921938 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-9b4d6594-dc79-4c59-8d53-c04b964ab506 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] [instance: dd66096c-0b64-4a26-bdec-1b1a46310cfb] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:49.929197 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-9b4d6594-dc79-4c59-8d53-c04b964ab506 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:49.929656 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-9b4d6594-dc79-4c59-8d53-c04b964ab506 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:49.930612 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-9b4d6594-dc79-4c59-8d53-c04b964ab506 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:49.931059 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-9b4d6594-dc79-4c59-8d53-c04b964ab506 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:50.091277 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-1a7e74a7-bdaf-433e-959e-f29abdbb4441 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:46:50.102995 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-1a7e74a7-bdaf-433e-959e-f29abdbb4441 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845" status: 200 len: 1366 microversion: 2.1 time: 0.218221 May 23 15:46:50.103565 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 308/594] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:49 2022] GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845 => generated 1366 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:46:50.108115 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-d40c6033-ca07-4b08-8347-eadb2aa104f6 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:50.109828 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-d40c6033-ca07-4b08-8347-eadb2aa104f6 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:50.115341 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-d40c6033-ca07-4b08-8347-eadb2aa104f6 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:50.115797 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-d40c6033-ca07-4b08-8347-eadb2aa104f6 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:50.116560 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-d40c6033-ca07-4b08-8347-eadb2aa104f6 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:50.116993 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-d40c6033-ca07-4b08-8347-eadb2aa104f6 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:50.121225 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-9b4d6594-dc79-4c59-8d53-c04b964ab506 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b983c0a2a124ac3aa3403e0777612f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0860b3d072246d49cd43a900351d571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:46:50.129397 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-9b4d6594-dc79-4c59-8d53-c04b964ab506 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] 10.222.0.64 "GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb" status: 200 len: 1567 microversion: 2.1 time: 0.213223 May 23 15:46:50.130054 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 287/595] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:49 2022] GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb => generated 1567 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:46:50.141676 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-d40c6033-ca07-4b08-8347-eadb2aa104f6 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Going to try to terminate instance {{(pid=124934) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 15:46:50.355614 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-d40c6033-ca07-4b08-8347-eadb2aa104f6 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "DELETE /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 204 len: 0 microversion: 2.1 time: 0.250811 May 23 15:46:50.356206 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 309/596] 10.222.0.64 () {58 vars in 1238 bytes} [Mon May 23 15:46:50 2022] DELETE /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 15:46:50.376248 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-f6e43fe3-2464-4557-8f13-ff292a477566 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:50.376861 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-f6e43fe3-2464-4557-8f13-ff292a477566 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:50.383010 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-f6e43fe3-2464-4557-8f13-ff292a477566 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:50.383472 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-f6e43fe3-2464-4557-8f13-ff292a477566 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:50.384271 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-f6e43fe3-2464-4557-8f13-ff292a477566 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:50.384706 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-f6e43fe3-2464-4557-8f13-ff292a477566 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:50.510256 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-f6e43fe3-2464-4557-8f13-ff292a477566 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:46:50.518522 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-f6e43fe3-2464-4557-8f13-ff292a477566 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 200 len: 1505 microversion: 2.1 time: 0.146158 May 23 15:46:50.519156 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 288/597] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:50 2022] GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 1505 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:46:51.121461 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-065a4686-450e-4aa0-9aff-04b9f10f6c38 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:51.122157 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-065a4686-450e-4aa0-9aff-04b9f10f6c38 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 8393c1a9-60d1-4b54-947d-3ef1a2e56845] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:51.128907 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-065a4686-450e-4aa0-9aff-04b9f10f6c38 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:51.129380 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-065a4686-450e-4aa0-9aff-04b9f10f6c38 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:51.130137 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-065a4686-450e-4aa0-9aff-04b9f10f6c38 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:51.130569 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-065a4686-450e-4aa0-9aff-04b9f10f6c38 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:51.145971 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-b49020f2-9b65-495f-b6fa-495d946ed858 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:51.146587 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-b49020f2-9b65-495f-b6fa-495d946ed858 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] [instance: dd66096c-0b64-4a26-bdec-1b1a46310cfb] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:51.152903 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b49020f2-9b65-495f-b6fa-495d946ed858 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:51.153386 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b49020f2-9b65-495f-b6fa-495d946ed858 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:51.154152 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b49020f2-9b65-495f-b6fa-495d946ed858 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:51.154591 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b49020f2-9b65-495f-b6fa-495d946ed858 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:51.336847 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-065a4686-450e-4aa0-9aff-04b9f10f6c38 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:46:51.341489 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-b49020f2-9b65-495f-b6fa-495d946ed858 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b983c0a2a124ac3aa3403e0777612f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0860b3d072246d49cd43a900351d571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:46:51.344747 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-065a4686-450e-4aa0-9aff-04b9f10f6c38 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845" status: 200 len: 1366 microversion: 2.1 time: 0.227548 May 23 15:46:51.345431 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 310/598] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:51 2022] GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845 => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:46:51.349285 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-b49020f2-9b65-495f-b6fa-495d946ed858 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] 10.222.0.64 "GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb" status: 200 len: 1567 microversion: 2.1 time: 0.207061 May 23 15:46:51.349844 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 289/599] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:51 2022] GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb => generated 1567 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:46:51.535986 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-5db7bd32-34e9-418f-8557-444fd12524f6 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:51.536596 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-5db7bd32-34e9-418f-8557-444fd12524f6 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:51.542571 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5db7bd32-34e9-418f-8557-444fd12524f6 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:51.543012 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5db7bd32-34e9-418f-8557-444fd12524f6 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:51.543763 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5db7bd32-34e9-418f-8557-444fd12524f6 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:51.544191 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5db7bd32-34e9-418f-8557-444fd12524f6 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:51.677430 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-5db7bd32-34e9-418f-8557-444fd12524f6 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:46:51.685016 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-5db7bd32-34e9-418f-8557-444fd12524f6 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 200 len: 1505 microversion: 2.1 time: 0.152890 May 23 15:46:51.685615 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 311/600] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:51 2022] GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:46:52.361710 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-40374090-6af3-4606-9169-8448803d056d tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:52.362321 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-40374090-6af3-4606-9169-8448803d056d tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 8393c1a9-60d1-4b54-947d-3ef1a2e56845] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:52.369333 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-40374090-6af3-4606-9169-8448803d056d tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:52.369791 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-40374090-6af3-4606-9169-8448803d056d tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:52.370591 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-40374090-6af3-4606-9169-8448803d056d tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:52.371032 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-40374090-6af3-4606-9169-8448803d056d tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:52.376706 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-fec7c642-487e-44e2-ba6e-6c4565c600cc tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:52.378186 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-fec7c642-487e-44e2-ba6e-6c4565c600cc tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] [instance: dd66096c-0b64-4a26-bdec-1b1a46310cfb] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:52.383585 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-fec7c642-487e-44e2-ba6e-6c4565c600cc tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:52.384033 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-fec7c642-487e-44e2-ba6e-6c4565c600cc tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:52.384800 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-fec7c642-487e-44e2-ba6e-6c4565c600cc tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:52.385270 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-fec7c642-487e-44e2-ba6e-6c4565c600cc tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:52.572084 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-40374090-6af3-4606-9169-8448803d056d tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:46:52.575859 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-fec7c642-487e-44e2-ba6e-6c4565c600cc tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b983c0a2a124ac3aa3403e0777612f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0860b3d072246d49cd43a900351d571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:46:52.579736 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-40374090-6af3-4606-9169-8448803d056d tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845" status: 200 len: 1366 microversion: 2.1 time: 0.222000 May 23 15:46:52.580311 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 290/601] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:52 2022] GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845 => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:46:52.583385 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-fec7c642-487e-44e2-ba6e-6c4565c600cc tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] 10.222.0.64 "GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb" status: 200 len: 1567 microversion: 2.1 time: 0.212065 May 23 15:46:52.583940 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 312/602] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:52 2022] GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb => generated 1567 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:46:52.702394 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-c235c331-409a-4e47-ab9f-5e4aa5b76155 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:52.703024 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-c235c331-409a-4e47-ab9f-5e4aa5b76155 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:52.709105 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c235c331-409a-4e47-ab9f-5e4aa5b76155 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:52.709562 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c235c331-409a-4e47-ab9f-5e4aa5b76155 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:52.710326 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c235c331-409a-4e47-ab9f-5e4aa5b76155 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:52.710766 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c235c331-409a-4e47-ab9f-5e4aa5b76155 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:52.841671 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-c235c331-409a-4e47-ab9f-5e4aa5b76155 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:46:52.849990 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-c235c331-409a-4e47-ab9f-5e4aa5b76155 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 200 len: 1505 microversion: 2.1 time: 0.151944 May 23 15:46:52.850661 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 291/603] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:52 2022] GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:46:53.596796 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-6e29fe8f-43dc-4e0c-aa54-92b54bb9f89e tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:53.597410 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-6e29fe8f-43dc-4e0c-aa54-92b54bb9f89e tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 8393c1a9-60d1-4b54-947d-3ef1a2e56845] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:53.599340 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-c1f47000-f6e6-433b-821a-ced614f12cb6 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:53.600381 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-c1f47000-f6e6-433b-821a-ced614f12cb6 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] [instance: dd66096c-0b64-4a26-bdec-1b1a46310cfb] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:53.603429 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-6e29fe8f-43dc-4e0c-aa54-92b54bb9f89e tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:53.603876 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-6e29fe8f-43dc-4e0c-aa54-92b54bb9f89e tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:53.604631 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-6e29fe8f-43dc-4e0c-aa54-92b54bb9f89e tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:53.605080 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-6e29fe8f-43dc-4e0c-aa54-92b54bb9f89e tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:53.607572 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c1f47000-f6e6-433b-821a-ced614f12cb6 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:53.608833 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c1f47000-f6e6-433b-821a-ced614f12cb6 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:53.610248 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c1f47000-f6e6-433b-821a-ced614f12cb6 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:53.610954 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c1f47000-f6e6-433b-821a-ced614f12cb6 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:53.805316 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-6e29fe8f-43dc-4e0c-aa54-92b54bb9f89e tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:46:53.809747 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-c1f47000-f6e6-433b-821a-ced614f12cb6 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b983c0a2a124ac3aa3403e0777612f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0860b3d072246d49cd43a900351d571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:46:53.812926 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-6e29fe8f-43dc-4e0c-aa54-92b54bb9f89e tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845" status: 200 len: 1557 microversion: 2.1 time: 0.219973 May 23 15:46:53.813681 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 313/604] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:53 2022] GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845 => generated 1557 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:46:53.817770 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-c1f47000-f6e6-433b-821a-ced614f12cb6 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] 10.222.0.64 "GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb" status: 200 len: 1567 microversion: 2.1 time: 0.222122 May 23 15:46:53.818433 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 292/605] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:53 2022] GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb => generated 1567 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:46:53.828835 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-073df5ff-2f47-458e-84da-201945133f1e tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:53.829362 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-073df5ff-2f47-458e-84da-201945133f1e tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 8393c1a9-60d1-4b54-947d-3ef1a2e56845] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:53.835583 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-073df5ff-2f47-458e-84da-201945133f1e tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:53.836032 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-073df5ff-2f47-458e-84da-201945133f1e tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:53.836797 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-073df5ff-2f47-458e-84da-201945133f1e tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:53.837266 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-073df5ff-2f47-458e-84da-201945133f1e tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:53.867882 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-29d4d2bb-040b-4bd4-8721-a5ea957783ca tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:53.868409 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-29d4d2bb-040b-4bd4-8721-a5ea957783ca tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:53.874630 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-29d4d2bb-040b-4bd4-8721-a5ea957783ca tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:53.878774 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-29d4d2bb-040b-4bd4-8721-a5ea957783ca tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:53.878774 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-29d4d2bb-040b-4bd4-8721-a5ea957783ca tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:53.878774 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-29d4d2bb-040b-4bd4-8721-a5ea957783ca tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:53.999099 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-073df5ff-2f47-458e-84da-201945133f1e tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.174100 May 23 15:46:54.000057 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 314/606] 10.222.0.64 () {58 vars in 1274 bytes} [Mon May 23 15:46:53 2022] GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845/os-interface => generated 285 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:46:54.151467 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-29d4d2bb-040b-4bd4-8721-a5ea957783ca tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:46:54.161464 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-29d4d2bb-040b-4bd4-8721-a5ea957783ca tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 200 len: 1505 microversion: 2.1 time: 0.297983 May 23 15:46:54.162977 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 293/607] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:53 2022] GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 1505 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:46:54.517904 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [req-1923ee62-a467-43b3-9e25-e795df845f5d req-e8d8cf44-35dc-43dc-9e1e-0366b796d258 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1210ee26-89ef-4f9e-b0e9-9534c3dd9d09", "name": "network-vif-deleted", "tag": "e89cca66-d50b-4f6c-a342-f64ba7767359"}]} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:46:54.527515 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-1923ee62-a467-43b3-9e25-e795df845f5d req-e8d8cf44-35dc-43dc-9e1e-0366b796d258 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:54.527967 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-1923ee62-a467-43b3-9e25-e795df845f5d req-e8d8cf44-35dc-43dc-9e1e-0366b796d258 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:54.540423 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.compute.server_external_events [req-1923ee62-a467-43b3-9e25-e795df845f5d req-e8d8cf44-35dc-43dc-9e1e-0366b796d258 service nova] Creating event network-vif-deleted:e89cca66-d50b-4f6c-a342-f64ba7767359 for instance 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 on hv-cinder-84067 May 23 15:46:54.545333 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [req-1923ee62-a467-43b3-9e25-e795df845f5d req-e8d8cf44-35dc-43dc-9e1e-0366b796d258 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031999 May 23 15:46:54.546781 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 315/608] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:46:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:46:54.835941 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-023e1a1f-ab51-4f24-87f8-3d947dc08689 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:54.836558 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-023e1a1f-ab51-4f24-87f8-3d947dc08689 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] [instance: dd66096c-0b64-4a26-bdec-1b1a46310cfb] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:54.844247 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-023e1a1f-ab51-4f24-87f8-3d947dc08689 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:54.845212 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-023e1a1f-ab51-4f24-87f8-3d947dc08689 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:54.846274 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-023e1a1f-ab51-4f24-87f8-3d947dc08689 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:54.846956 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-023e1a1f-ab51-4f24-87f8-3d947dc08689 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:54.998224 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-023e1a1f-ab51-4f24-87f8-3d947dc08689 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b983c0a2a124ac3aa3403e0777612f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0860b3d072246d49cd43a900351d571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:46:55.006600 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-023e1a1f-ab51-4f24-87f8-3d947dc08689 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] 10.222.0.64 "GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb" status: 200 len: 1567 microversion: 2.1 time: 0.176032 May 23 15:46:55.009097 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 294/609] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:54 2022] GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:46:55.180295 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-f5cbfbbe-d407-4198-a435-94eea3c999ff tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:55.181020 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-f5cbfbbe-d407-4198-a435-94eea3c999ff tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:55.187609 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-f5cbfbbe-d407-4198-a435-94eea3c999ff tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:55.188053 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-f5cbfbbe-d407-4198-a435-94eea3c999ff tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:55.188823 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-f5cbfbbe-d407-4198-a435-94eea3c999ff tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:55.189299 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-f5cbfbbe-d407-4198-a435-94eea3c999ff tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:55.222847 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-f5cbfbbe-d407-4198-a435-94eea3c999ff tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:55.223296 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-f5cbfbbe-d407-4198-a435-94eea3c999ff tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:55.223745 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.objects.instance [None req-f5cbfbbe-d407-4198-a435-94eea3c999ff tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lazy-loading 'fault' on Instance uuid 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 {{(pid=124934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 15:46:55.275223 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-f5cbfbbe-d407-4198-a435-94eea3c999ff tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:46:55.282845 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-f5cbfbbe-d407-4198-a435-94eea3c999ff tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 200 len: 1311 microversion: 2.1 time: 0.106694 May 23 15:46:55.283341 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 316/610] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:55 2022] GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 1311 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:46:55.328795 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [req-0af62169-053a-4abc-8e11-b7df81c2d5cf req-5227e310-52ea-40ca-b788-0d1384de9024 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8393c1a9-60d1-4b54-947d-3ef1a2e56845", "tag": "ab319228-d2e4-408a-a8f8-6e3febb2286b"}]} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:46:55.341025 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-0af62169-053a-4abc-8e11-b7df81c2d5cf req-5227e310-52ea-40ca-b788-0d1384de9024 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:55.341487 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-0af62169-053a-4abc-8e11-b7df81c2d5cf req-5227e310-52ea-40ca-b788-0d1384de9024 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:55.353504 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.compute.server_external_events [req-0af62169-053a-4abc-8e11-b7df81c2d5cf req-5227e310-52ea-40ca-b788-0d1384de9024 service nova] Creating event network-changed:ab319228-d2e4-408a-a8f8-6e3febb2286b for instance 8393c1a9-60d1-4b54-947d-3ef1a2e56845 on hv-cinder-84067 May 23 15:46:55.358758 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [req-0af62169-053a-4abc-8e11-b7df81c2d5cf req-5227e310-52ea-40ca-b788-0d1384de9024 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037639 May 23 15:46:55.359448 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 295/611] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:46:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:46:56.025655 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-203c53dd-9b27-4d3a-9bfa-05c257a0aae6 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:56.026268 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-203c53dd-9b27-4d3a-9bfa-05c257a0aae6 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] [instance: dd66096c-0b64-4a26-bdec-1b1a46310cfb] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:56.033295 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-203c53dd-9b27-4d3a-9bfa-05c257a0aae6 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:56.033761 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-203c53dd-9b27-4d3a-9bfa-05c257a0aae6 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:56.034540 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-203c53dd-9b27-4d3a-9bfa-05c257a0aae6 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:56.034979 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-203c53dd-9b27-4d3a-9bfa-05c257a0aae6 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:56.055628 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:56.176896 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-203c53dd-9b27-4d3a-9bfa-05c257a0aae6 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b983c0a2a124ac3aa3403e0777612f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0860b3d072246d49cd43a900351d571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:46:56.184628 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-203c53dd-9b27-4d3a-9bfa-05c257a0aae6 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] 10.222.0.64 "GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb" status: 200 len: 1567 microversion: 2.1 time: 0.163648 May 23 15:46:56.185429 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 317/612] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:56 2022] GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:46:56.308804 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-fcfa75c5-84c0-432f-9098-e5e35b2d42bb tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:56.309461 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-fcfa75c5-84c0-432f-9098-e5e35b2d42bb tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:56.316332 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-fcfa75c5-84c0-432f-9098-e5e35b2d42bb tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:56.316780 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-fcfa75c5-84c0-432f-9098-e5e35b2d42bb tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:56.317587 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-fcfa75c5-84c0-432f-9098-e5e35b2d42bb tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:56.318021 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-fcfa75c5-84c0-432f-9098-e5e35b2d42bb tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:56.332771 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.wsgi [None req-fcfa75c5-84c0-432f-9098-e5e35b2d42bb tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] HTTP exception thrown: Instance 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 could not be found. May 23 15:46:56.334487 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-fcfa75c5-84c0-432f-9098-e5e35b2d42bb tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Request method failure captured: May 23 15:46:56.334487 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: request: GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 HTTP/1.1 May 23 15:46:56.334487 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Accept: application/json May 23 15:46:56.334487 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Accept-Encoding: identity May 23 15:46:56.334487 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Connection: close May 23 15:46:56.334487 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Content-Length: 0 May 23 15:46:56.334487 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Content-Type: application/json May 23 15:46:56.334487 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Host: 10.222.0.64 May 23 15:46:56.334487 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Openstack-System-Scope: None May 23 15:46:56.334487 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: User-Agent: python-urllib3/1.26.9 May 23 15:46:56.334487 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Auth-Token: gAAAAABii6s54KKAZxlQBYzhx-noNW6ImMu_qK18vzcxUodmAjvvJq-5TbaxZQIihTpeBFGJg_t4VXTJRBBdNp2S6NOFiVOcgKlGDwULP0bkoXn2Lrupumn987Hv9EwEHbef7k6ahcCsqTc5NRw34uO7WRPXXMvHMUWgqgfV68m8j7DAWMdthmk May 23 15:46:56.334487 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Domain-Id: None May 23 15:46:56.334487 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Domain-Name: None May 23 15:46:56.334487 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Identity-Status: Confirmed May 23 15:46:56.334487 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Is-Admin-Project: True May 23 15:46:56.334487 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Domain-Id: default May 23 15:46:56.334487 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Domain-Name: Default May 23 15:46:56.334487 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Id: 65483f2a0c914022b38e501691095c51 May 23 15:46:56.334487 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1263770255 May 23 15:46:56.334487 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Role: reader,member May 23 15:46:56.334487 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Roles: reader,member May 23 15:46:56.336123 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/65483f2a0c914022b38e501691095c51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/65483f2a0c914022b38e501691095c51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/65483f2a0c914022b38e501691095c51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_65483f2a0c914022b38e501691095c51", "adminURL": "http://10.222.0.64:8080"}]}] May 23 15:46:56.336123 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1263770255 May 23 15:46:56.336123 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant-Id: 65483f2a0c914022b38e501691095c51 May 23 15:46:56.336123 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1263770255 May 23 15:46:56.336123 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User: tempest-ServerRescueNegativeTestJSON-1263770255-project May 23 15:46:56.336123 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Domain-Id: default May 23 15:46:56.336123 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Domain-Name: Default May 23 15:46:56.336123 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Id: a2f1d435732b4ff0a60599309c66eeb5 May 23 15:46:56.336123 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1263770255-project May 23 15:46:56.336123 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: method: > May 23 15:46:56.336123 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: exception: Instance 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 could not be found. May 23 15:46:56.336123 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: action_args: {'id': '1210ee26-89ef-4f9e-b0e9-9534c3dd9d09'} May 23 15:46:56.337173 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:46:56.337173 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:46:56.337173 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:46:56.337173 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:46:56.337173 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:46:56.337173 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:46:56.337173 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:46:56.337173 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:46:56.337173 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:46:56.337173 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:46:56.337173 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 could not be found. May 23 15:46:56.337173 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:46:56.337173 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:46:56.337173 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:46:56.337173 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:46:56.337173 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:46:56.337173 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:46:56.337173 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:46:56.337173 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:46:56.337173 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:46:56.338872 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:46:56.338872 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 15:46:56.338872 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 15:46:56.338872 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:46:56.338872 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:46:56.338872 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:46:56.338872 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:46:56.338872 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 could not be found. May 23 15:46:56.338872 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:46:56.338872 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:46:56.338872 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:46:56.338872 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:46:56.338872 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:46:56.338872 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:46:56.338872 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:46:56.338872 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:46:56.338872 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 could not be found. May 23 15:46:56.338872 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:46:56.340853 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-fcfa75c5-84c0-432f-9098-e5e35b2d42bb tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Returning 404 to user: Instance 1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 could not be found. {{(pid=124933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:46:56.340853 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-fcfa75c5-84c0-432f-9098-e5e35b2d42bb tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09" status: 404 len: 111 microversion: 2.1 time: 0.031850 May 23 15:46:56.340853 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 296/613] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:56 2022] GET /compute/v2.1/servers/1210ee26-89ef-4f9e-b0e9-9534c3dd9d09 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 15:46:56.344808 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-b95a8afa-d4a1-4565-b25f-ad750d84c3ff tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:56.345328 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-b95a8afa-d4a1-4565-b25f-ad750d84c3ff tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: bbe72f52-c8f9-46ea-ae59-9d2fe0a49523] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:56.352019 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-b95a8afa-d4a1-4565-b25f-ad750d84c3ff tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:56.352468 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-b95a8afa-d4a1-4565-b25f-ad750d84c3ff tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:56.353327 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-b95a8afa-d4a1-4565-b25f-ad750d84c3ff tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:56.353686 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-b95a8afa-d4a1-4565-b25f-ad750d84c3ff tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:56.381598 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-b95a8afa-d4a1-4565-b25f-ad750d84c3ff tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: bbe72f52-c8f9-46ea-ae59-9d2fe0a49523] Going to try to terminate instance {{(pid=124934) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 15:46:56.721516 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-b95a8afa-d4a1-4565-b25f-ad750d84c3ff tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "DELETE /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523" status: 204 len: 0 microversion: 2.1 time: 0.380397 May 23 15:46:56.722109 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 318/614] 10.222.0.64 () {58 vars in 1238 bytes} [Mon May 23 15:46:56 2022] DELETE /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 15:46:56.731018 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-c5a61ea7-2a83-4013-ac82-f15d51b36561 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:56.731018 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-c5a61ea7-2a83-4013-ac82-f15d51b36561 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: bbe72f52-c8f9-46ea-ae59-9d2fe0a49523] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:56.738229 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c5a61ea7-2a83-4013-ac82-f15d51b36561 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:56.738688 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c5a61ea7-2a83-4013-ac82-f15d51b36561 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:56.739459 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c5a61ea7-2a83-4013-ac82-f15d51b36561 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:56.739893 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c5a61ea7-2a83-4013-ac82-f15d51b36561 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:56.883894 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-c5a61ea7-2a83-4013-ac82-f15d51b36561 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:46:56.891309 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-c5a61ea7-2a83-4013-ac82-f15d51b36561 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523" status: 200 len: 1519 microversion: 2.1 time: 0.165088 May 23 15:46:56.891956 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 297/615] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:56 2022] GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523 => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:46:57.203542 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-f6be5370-a5f7-4d94-b302-db4af3e5d1bb tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:57.204180 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-f6be5370-a5f7-4d94-b302-db4af3e5d1bb tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] [instance: dd66096c-0b64-4a26-bdec-1b1a46310cfb] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:57.210209 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-f6be5370-a5f7-4d94-b302-db4af3e5d1bb tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:57.210665 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-f6be5370-a5f7-4d94-b302-db4af3e5d1bb tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:57.211434 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-f6be5370-a5f7-4d94-b302-db4af3e5d1bb tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:57.211874 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-f6be5370-a5f7-4d94-b302-db4af3e5d1bb tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:57.340912 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-f6be5370-a5f7-4d94-b302-db4af3e5d1bb tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b983c0a2a124ac3aa3403e0777612f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0860b3d072246d49cd43a900351d571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:46:57.349002 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-f6be5370-a5f7-4d94-b302-db4af3e5d1bb tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] 10.222.0.64 "GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb" status: 200 len: 1567 microversion: 2.1 time: 0.150391 May 23 15:46:57.351326 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 319/616] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:57 2022] GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:46:57.908453 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-6bc0efea-b54a-4735-a95b-26e9853b740e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:57.909090 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-6bc0efea-b54a-4735-a95b-26e9853b740e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: bbe72f52-c8f9-46ea-ae59-9d2fe0a49523] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:57.915573 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-6bc0efea-b54a-4735-a95b-26e9853b740e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:57.916023 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-6bc0efea-b54a-4735-a95b-26e9853b740e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:57.916785 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-6bc0efea-b54a-4735-a95b-26e9853b740e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:57.917252 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-6bc0efea-b54a-4735-a95b-26e9853b740e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:58.042957 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-6bc0efea-b54a-4735-a95b-26e9853b740e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:46:58.046979 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_cell1:SELECT=100 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:46:58.051497 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-6bc0efea-b54a-4735-a95b-26e9853b740e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523" status: 200 len: 1519 microversion: 2.1 time: 0.147349 May 23 15:46:58.052055 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 298/617] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:57 2022] GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523 => generated 1519 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:46:58.366597 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-1bd66c39-3251-4aaa-ac93-6f75e573fd5c tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:58.367211 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-1bd66c39-3251-4aaa-ac93-6f75e573fd5c tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] [instance: dd66096c-0b64-4a26-bdec-1b1a46310cfb] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:58.373367 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-1bd66c39-3251-4aaa-ac93-6f75e573fd5c tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:58.374384 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-1bd66c39-3251-4aaa-ac93-6f75e573fd5c tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:58.375159 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-1bd66c39-3251-4aaa-ac93-6f75e573fd5c tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:58.375598 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-1bd66c39-3251-4aaa-ac93-6f75e573fd5c tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:58.513157 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-1bd66c39-3251-4aaa-ac93-6f75e573fd5c tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b983c0a2a124ac3aa3403e0777612f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0860b3d072246d49cd43a900351d571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:46:58.520642 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-1bd66c39-3251-4aaa-ac93-6f75e573fd5c tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] 10.222.0.64 "GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb" status: 200 len: 1567 microversion: 2.1 time: 0.157999 May 23 15:46:58.521266 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 320/618] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:58 2022] GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:46:59.068074 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-83b5d079-c362-46dc-98f3-56e369213471 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:59.073389 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-83b5d079-c362-46dc-98f3-56e369213471 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: bbe72f52-c8f9-46ea-ae59-9d2fe0a49523] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:59.075583 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-83b5d079-c362-46dc-98f3-56e369213471 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:59.076035 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-83b5d079-c362-46dc-98f3-56e369213471 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:59.077453 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-83b5d079-c362-46dc-98f3-56e369213471 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:59.077909 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-83b5d079-c362-46dc-98f3-56e369213471 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:59.206263 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-83b5d079-c362-46dc-98f3-56e369213471 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:46:59.213634 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-83b5d079-c362-46dc-98f3-56e369213471 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523" status: 200 len: 1519 microversion: 2.1 time: 0.149497 May 23 15:46:59.214203 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 299/619] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:59 2022] GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523 => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:46:59.537363 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-4876d4d9-0c32-4550-8efd-7b7bb38d1621 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:46:59.537977 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-4876d4d9-0c32-4550-8efd-7b7bb38d1621 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] [instance: dd66096c-0b64-4a26-bdec-1b1a46310cfb] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:46:59.544138 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4876d4d9-0c32-4550-8efd-7b7bb38d1621 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:59.544586 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4876d4d9-0c32-4550-8efd-7b7bb38d1621 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:59.545367 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4876d4d9-0c32-4550-8efd-7b7bb38d1621 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:46:59.546371 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4876d4d9-0c32-4550-8efd-7b7bb38d1621 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:46:59.679339 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-4876d4d9-0c32-4550-8efd-7b7bb38d1621 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b983c0a2a124ac3aa3403e0777612f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0860b3d072246d49cd43a900351d571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:46:59.687390 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-4876d4d9-0c32-4550-8efd-7b7bb38d1621 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] 10.222.0.64 "GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb" status: 200 len: 1567 microversion: 2.1 time: 0.153819 May 23 15:46:59.687954 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 321/620] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:46:59 2022] GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:47:00.231208 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-a25ee7d1-b003-4b8c-99b8-167ceea0f35f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:47:00.231970 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-a25ee7d1-b003-4b8c-99b8-167ceea0f35f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: bbe72f52-c8f9-46ea-ae59-9d2fe0a49523] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:00.239042 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a25ee7d1-b003-4b8c-99b8-167ceea0f35f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:00.239506 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a25ee7d1-b003-4b8c-99b8-167ceea0f35f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:00.240405 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a25ee7d1-b003-4b8c-99b8-167ceea0f35f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:00.240853 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a25ee7d1-b003-4b8c-99b8-167ceea0f35f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:00.703856 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-0626f097-8002-4a06-accf-a3b0da68c3e9 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:47:00.704483 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-0626f097-8002-4a06-accf-a3b0da68c3e9 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] [instance: dd66096c-0b64-4a26-bdec-1b1a46310cfb] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:00.711031 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0626f097-8002-4a06-accf-a3b0da68c3e9 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:00.711494 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0626f097-8002-4a06-accf-a3b0da68c3e9 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:00.712270 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0626f097-8002-4a06-accf-a3b0da68c3e9 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:00.712717 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0626f097-8002-4a06-accf-a3b0da68c3e9 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:00.729712 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-a25ee7d1-b003-4b8c-99b8-167ceea0f35f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:47:00.738117 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-a25ee7d1-b003-4b8c-99b8-167ceea0f35f tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523" status: 200 len: 1519 microversion: 2.1 time: 0.510936 May 23 15:47:00.738895 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 300/621] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:47:00 2022] GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523 => generated 1519 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:47:00.924065 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-0626f097-8002-4a06-accf-a3b0da68c3e9 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b983c0a2a124ac3aa3403e0777612f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0860b3d072246d49cd43a900351d571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:47:00.931705 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-0626f097-8002-4a06-accf-a3b0da68c3e9 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] 10.222.0.64 "GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb" status: 200 len: 1567 microversion: 2.1 time: 0.231852 May 23 15:47:00.932268 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 322/622] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:47:00 2022] GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb => generated 1567 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:47:01.199957 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [req-76a1a923-4185-4028-afaf-30de776631fc req-8f4b42f8-780f-4c62-9098-fb26372059bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbe72f52-c8f9-46ea-ae59-9d2fe0a49523", "name": "network-vif-deleted", "tag": "d9ed8cc1-0b96-4f2b-a6a8-4413cb65225f"}]} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:47:01.208163 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-76a1a923-4185-4028-afaf-30de776631fc req-8f4b42f8-780f-4c62-9098-fb26372059bf service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:01.208610 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-76a1a923-4185-4028-afaf-30de776631fc req-8f4b42f8-780f-4c62-9098-fb26372059bf service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:01.219250 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.compute.server_external_events [req-76a1a923-4185-4028-afaf-30de776631fc req-8f4b42f8-780f-4c62-9098-fb26372059bf service nova] Creating event network-vif-deleted:d9ed8cc1-0b96-4f2b-a6a8-4413cb65225f for instance bbe72f52-c8f9-46ea-ae59-9d2fe0a49523 on hv-cinder-84067 May 23 15:47:01.223931 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [req-76a1a923-4185-4028-afaf-30de776631fc req-8f4b42f8-780f-4c62-9098-fb26372059bf service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027730 May 23 15:47:01.224507 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 301/623] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:47:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:47:01.755298 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-f730f99f-c8e3-4370-a9c1-18b3cbaebf91 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:47:01.755818 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-f730f99f-c8e3-4370-a9c1-18b3cbaebf91 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: bbe72f52-c8f9-46ea-ae59-9d2fe0a49523] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:01.761813 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-f730f99f-c8e3-4370-a9c1-18b3cbaebf91 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:01.762265 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-f730f99f-c8e3-4370-a9c1-18b3cbaebf91 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:01.763024 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-f730f99f-c8e3-4370-a9c1-18b3cbaebf91 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:01.763458 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-f730f99f-c8e3-4370-a9c1-18b3cbaebf91 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:01.824157 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-f730f99f-c8e3-4370-a9c1-18b3cbaebf91 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:47:01.832170 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-f730f99f-c8e3-4370-a9c1-18b3cbaebf91 tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523" status: 200 len: 1477 microversion: 2.1 time: 0.080871 May 23 15:47:01.832745 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 323/624] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:47:01 2022] GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523 => generated 1477 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:47:01.951278 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-8065210e-b01b-4469-bc72-37e768ca1d54 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:47:01.952496 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-8065210e-b01b-4469-bc72-37e768ca1d54 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] [instance: dd66096c-0b64-4a26-bdec-1b1a46310cfb] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:01.958714 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-8065210e-b01b-4469-bc72-37e768ca1d54 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:01.959167 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-8065210e-b01b-4469-bc72-37e768ca1d54 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:01.959925 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-8065210e-b01b-4469-bc72-37e768ca1d54 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:01.960361 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-8065210e-b01b-4469-bc72-37e768ca1d54 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:02.092151 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-8065210e-b01b-4469-bc72-37e768ca1d54 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b983c0a2a124ac3aa3403e0777612f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0860b3d072246d49cd43a900351d571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:47:02.099684 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-8065210e-b01b-4469-bc72-37e768ca1d54 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] 10.222.0.64 "GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb" status: 200 len: 1567 microversion: 2.1 time: 0.153063 May 23 15:47:02.101587 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 302/625] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:47:01 2022] GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:47:02.849121 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-7420f39c-9d8e-4843-a315-659a048daddf tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:47:02.849812 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-7420f39c-9d8e-4843-a315-659a048daddf tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: bbe72f52-c8f9-46ea-ae59-9d2fe0a49523] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:02.855840 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-7420f39c-9d8e-4843-a315-659a048daddf tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:02.856315 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-7420f39c-9d8e-4843-a315-659a048daddf tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:02.857083 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-7420f39c-9d8e-4843-a315-659a048daddf tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:02.857513 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-7420f39c-9d8e-4843-a315-659a048daddf tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:02.893644 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-7420f39c-9d8e-4843-a315-659a048daddf tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:02.894093 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-7420f39c-9d8e-4843-a315-659a048daddf tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:02.894537 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.objects.instance [None req-7420f39c-9d8e-4843-a315-659a048daddf tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lazy-loading 'fault' on Instance uuid bbe72f52-c8f9-46ea-ae59-9d2fe0a49523 {{(pid=124934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 15:47:02.937718 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-7420f39c-9d8e-4843-a315-659a048daddf tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2f1d435732b4ff0a60599309c66eeb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65483f2a0c914022b38e501691095c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:47:02.945277 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-7420f39c-9d8e-4843-a315-659a048daddf tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523" status: 200 len: 1311 microversion: 2.1 time: 0.099970 May 23 15:47:02.945834 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 324/626] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:47:02 2022] GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523 => generated 1311 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:47:03.117643 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-4ee72679-33fc-4eca-9e4b-69c133cfaa59 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:47:03.118884 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-4ee72679-33fc-4eca-9e4b-69c133cfaa59 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] [instance: dd66096c-0b64-4a26-bdec-1b1a46310cfb] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:03.126377 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-4ee72679-33fc-4eca-9e4b-69c133cfaa59 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:03.131480 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-4ee72679-33fc-4eca-9e4b-69c133cfaa59 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:03.131480 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-4ee72679-33fc-4eca-9e4b-69c133cfaa59 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:03.131480 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-4ee72679-33fc-4eca-9e4b-69c133cfaa59 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:03.284578 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-4ee72679-33fc-4eca-9e4b-69c133cfaa59 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b983c0a2a124ac3aa3403e0777612f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0860b3d072246d49cd43a900351d571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:47:03.292186 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-4ee72679-33fc-4eca-9e4b-69c133cfaa59 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] 10.222.0.64 "GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb" status: 200 len: 1567 microversion: 2.1 time: 0.178553 May 23 15:47:03.294417 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 303/627] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:47:03 2022] GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb => generated 1567 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:47:03.962526 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-af687773-1847-4312-9c1c-f90d4733828e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:47:03.963247 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-af687773-1847-4312-9c1c-f90d4733828e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] [instance: bbe72f52-c8f9-46ea-ae59-9d2fe0a49523] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:03.966306 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:47:03.969781 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-af687773-1847-4312-9c1c-f90d4733828e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:03.970239 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-af687773-1847-4312-9c1c-f90d4733828e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:03.971049 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-af687773-1847-4312-9c1c-f90d4733828e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:03.971497 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-af687773-1847-4312-9c1c-f90d4733828e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:03.985407 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.wsgi [None req-af687773-1847-4312-9c1c-f90d4733828e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] HTTP exception thrown: Instance bbe72f52-c8f9-46ea-ae59-9d2fe0a49523 could not be found. May 23 15:47:03.987062 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-af687773-1847-4312-9c1c-f90d4733828e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Request method failure captured: May 23 15:47:03.987062 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: request: GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523 HTTP/1.1 May 23 15:47:03.987062 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Accept: application/json May 23 15:47:03.987062 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Accept-Encoding: identity May 23 15:47:03.987062 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Connection: close May 23 15:47:03.987062 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Content-Length: 0 May 23 15:47:03.987062 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Content-Type: application/json May 23 15:47:03.987062 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Host: 10.222.0.64 May 23 15:47:03.987062 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Openstack-System-Scope: None May 23 15:47:03.987062 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: User-Agent: python-urllib3/1.26.9 May 23 15:47:03.987062 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Auth-Token: gAAAAABii6s54KKAZxlQBYzhx-noNW6ImMu_qK18vzcxUodmAjvvJq-5TbaxZQIihTpeBFGJg_t4VXTJRBBdNp2S6NOFiVOcgKlGDwULP0bkoXn2Lrupumn987Hv9EwEHbef7k6ahcCsqTc5NRw34uO7WRPXXMvHMUWgqgfV68m8j7DAWMdthmk May 23 15:47:03.987062 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Domain-Id: None May 23 15:47:03.987062 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Domain-Name: None May 23 15:47:03.987062 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Identity-Status: Confirmed May 23 15:47:03.987062 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Is-Admin-Project: True May 23 15:47:03.987062 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Domain-Id: default May 23 15:47:03.987062 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Domain-Name: Default May 23 15:47:03.987062 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Id: 65483f2a0c914022b38e501691095c51 May 23 15:47:03.987062 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1263770255 May 23 15:47:03.987062 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Role: reader,member May 23 15:47:03.987062 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Roles: reader,member May 23 15:47:03.988414 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/65483f2a0c914022b38e501691095c51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/65483f2a0c914022b38e501691095c51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/65483f2a0c914022b38e501691095c51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_65483f2a0c914022b38e501691095c51", "adminURL": "http://10.222.0.64:8080"}]}] May 23 15:47:03.988414 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1263770255 May 23 15:47:03.988414 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant-Id: 65483f2a0c914022b38e501691095c51 May 23 15:47:03.988414 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1263770255 May 23 15:47:03.988414 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User: tempest-ServerRescueNegativeTestJSON-1263770255-project May 23 15:47:03.988414 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Domain-Id: default May 23 15:47:03.988414 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Domain-Name: Default May 23 15:47:03.988414 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Id: a2f1d435732b4ff0a60599309c66eeb5 May 23 15:47:03.988414 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1263770255-project May 23 15:47:03.988414 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: method: > May 23 15:47:03.988414 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: exception: Instance bbe72f52-c8f9-46ea-ae59-9d2fe0a49523 could not be found. May 23 15:47:03.988414 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: action_args: {'id': 'bbe72f52-c8f9-46ea-ae59-9d2fe0a49523'} May 23 15:47:03.989187 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:47:03.989187 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:47:03.989187 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:47:03.989187 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:47:03.989187 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:47:03.989187 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:47:03.989187 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:47:03.989187 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:47:03.989187 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:47:03.989187 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:47:03.989187 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbe72f52-c8f9-46ea-ae59-9d2fe0a49523 could not be found. May 23 15:47:03.989187 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:47:03.989187 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:47:03.989187 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:47:03.989187 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:47:03.989187 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:47:03.989187 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:47:03.989187 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:47:03.989187 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:47:03.989187 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:47:03.990546 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:47:03.990546 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 15:47:03.990546 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 15:47:03.990546 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:47:03.990546 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:47:03.990546 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:47:03.990546 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:47:03.990546 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbe72f52-c8f9-46ea-ae59-9d2fe0a49523 could not be found. May 23 15:47:03.990546 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:47:03.990546 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:47:03.990546 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:47:03.990546 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:47:03.990546 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:47:03.990546 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:47:03.990546 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:47:03.990546 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:47:03.990546 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbe72f52-c8f9-46ea-ae59-9d2fe0a49523 could not be found. May 23 15:47:03.990546 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:47:03.991919 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-af687773-1847-4312-9c1c-f90d4733828e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] Returning 404 to user: Instance bbe72f52-c8f9-46ea-ae59-9d2fe0a49523 could not be found. {{(pid=124934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:47:03.991919 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-af687773-1847-4312-9c1c-f90d4733828e tempest-ServerRescueNegativeTestJSON-1263770255 tempest-ServerRescueNegativeTestJSON-1263770255-project] 10.222.0.64 "GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523" status: 404 len: 111 microversion: 2.1 time: 0.029764 May 23 15:47:03.991919 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 325/628] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:47:03 2022] GET /compute/v2.1/servers/bbe72f52-c8f9-46ea-ae59-9d2fe0a49523 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 15:47:04.310504 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-fbc27411-c0a7-4bd7-b082-63b2782d592b tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:47:04.311387 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-fbc27411-c0a7-4bd7-b082-63b2782d592b tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] [instance: dd66096c-0b64-4a26-bdec-1b1a46310cfb] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:04.317768 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-fbc27411-c0a7-4bd7-b082-63b2782d592b tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:04.319933 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-fbc27411-c0a7-4bd7-b082-63b2782d592b tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:04.319933 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-fbc27411-c0a7-4bd7-b082-63b2782d592b tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:04.319933 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-fbc27411-c0a7-4bd7-b082-63b2782d592b tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:04.450629 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-fbc27411-c0a7-4bd7-b082-63b2782d592b tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b983c0a2a124ac3aa3403e0777612f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0860b3d072246d49cd43a900351d571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:47:04.459846 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-fbc27411-c0a7-4bd7-b082-63b2782d592b tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] 10.222.0.64 "GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb" status: 200 len: 1508 microversion: 2.1 time: 0.153537 May 23 15:47:04.460421 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 304/629] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:47:04 2022] GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:47:04.476753 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-9fd3349f-e7c4-4c69-83f7-43c62eed776a tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:47:04.477367 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-9fd3349f-e7c4-4c69-83f7-43c62eed776a tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] [instance: dd66096c-0b64-4a26-bdec-1b1a46310cfb] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:04.483690 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-9fd3349f-e7c4-4c69-83f7-43c62eed776a tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:04.484148 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-9fd3349f-e7c4-4c69-83f7-43c62eed776a tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:04.484926 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-9fd3349f-e7c4-4c69-83f7-43c62eed776a tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:04.485477 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-9fd3349f-e7c4-4c69-83f7-43c62eed776a tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:04.735519 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-9fd3349f-e7c4-4c69-83f7-43c62eed776a tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] 10.222.0.64 "POST /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb/action" status: 202 len: 0 microversion: 2.1 time: 0.262821 May 23 15:47:04.736704 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 326/630] 10.222.0.64 () {60 vars in 1277 bytes} [Mon May 23 15:47:04 2022] POST /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 15:47:04.744661 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-6ff66196-2e3b-4afa-9baf-2471957aeccd tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:47:04.745380 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-6ff66196-2e3b-4afa-9baf-2471957aeccd tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] [instance: dd66096c-0b64-4a26-bdec-1b1a46310cfb] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:04.752724 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-6ff66196-2e3b-4afa-9baf-2471957aeccd tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:04.753836 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-6ff66196-2e3b-4afa-9baf-2471957aeccd tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:04.754859 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-6ff66196-2e3b-4afa-9baf-2471957aeccd tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:04.755517 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-6ff66196-2e3b-4afa-9baf-2471957aeccd tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:04.912806 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-6ff66196-2e3b-4afa-9baf-2471957aeccd tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b983c0a2a124ac3aa3403e0777612f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0860b3d072246d49cd43a900351d571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:47:04.921185 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-6ff66196-2e3b-4afa-9baf-2471957aeccd tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] 10.222.0.64 "GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb" status: 200 len: 1516 microversion: 2.1 time: 0.179567 May 23 15:47:04.922301 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 305/631] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:47:04 2022] GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb => generated 1516 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:47:05.251127 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [req-f2b03920-c64c-46bc-b8a1-c0a2f98b37fa req-b2415f70-52c7-4ef7-b08a-5f547bb194c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd66096c-0b64-4a26-bdec-1b1a46310cfb", "name": "network-vif-unplugged", "status": "completed", "tag": "a0610243-2466-4315-a3e6-15f6cea816b8"}]} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:47:05.259325 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-f2b03920-c64c-46bc-b8a1-c0a2f98b37fa req-b2415f70-52c7-4ef7-b08a-5f547bb194c1 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:05.259784 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-f2b03920-c64c-46bc-b8a1-c0a2f98b37fa req-b2415f70-52c7-4ef7-b08a-5f547bb194c1 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:05.272271 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.compute.server_external_events [req-f2b03920-c64c-46bc-b8a1-c0a2f98b37fa req-b2415f70-52c7-4ef7-b08a-5f547bb194c1 service nova] Unable to find a host for instance dd66096c-0b64-4a26-bdec-1b1a46310cfb. Dropping event network-vif-unplugged {{(pid=124934) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 23 15:47:05.273426 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [req-f2b03920-c64c-46bc-b8a1-c0a2f98b37fa req-b2415f70-52c7-4ef7-b08a-5f547bb194c1 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027250 May 23 15:47:05.277378 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 327/632] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:47:05 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 23 15:47:05.947109 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-ad802671-f79c-4142-a658-2caf29f72a07 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:47:05.948371 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-ad802671-f79c-4142-a658-2caf29f72a07 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] [instance: dd66096c-0b64-4a26-bdec-1b1a46310cfb] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:05.956075 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ad802671-f79c-4142-a658-2caf29f72a07 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:05.956533 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ad802671-f79c-4142-a658-2caf29f72a07 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:05.957330 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ad802671-f79c-4142-a658-2caf29f72a07 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:05.957763 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ad802671-f79c-4142-a658-2caf29f72a07 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:06.101189 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-ad802671-f79c-4142-a658-2caf29f72a07 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b983c0a2a124ac3aa3403e0777612f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0860b3d072246d49cd43a900351d571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:47:06.109782 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-ad802671-f79c-4142-a658-2caf29f72a07 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] 10.222.0.64 "GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb" status: 200 len: 1516 microversion: 2.1 time: 0.166313 May 23 15:47:06.110667 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 306/633] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:47:05 2022] GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb => generated 1516 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:47:07.128222 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-e64bc3d3-4217-4eaa-a19d-5f098846d6f6 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:47:07.129532 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-e64bc3d3-4217-4eaa-a19d-5f098846d6f6 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] [instance: dd66096c-0b64-4a26-bdec-1b1a46310cfb] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:07.136446 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e64bc3d3-4217-4eaa-a19d-5f098846d6f6 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:07.136902 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e64bc3d3-4217-4eaa-a19d-5f098846d6f6 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:07.137925 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e64bc3d3-4217-4eaa-a19d-5f098846d6f6 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:07.138373 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e64bc3d3-4217-4eaa-a19d-5f098846d6f6 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:07.305216 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-e64bc3d3-4217-4eaa-a19d-5f098846d6f6 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b983c0a2a124ac3aa3403e0777612f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0860b3d072246d49cd43a900351d571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:47:07.316393 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-e64bc3d3-4217-4eaa-a19d-5f098846d6f6 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] 10.222.0.64 "GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb" status: 200 len: 1518 microversion: 2.1 time: 0.192362 May 23 15:47:07.316979 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 328/634] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:47:07 2022] GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb => generated 1518 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:47:08.343833 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-27f1ce2e-568c-4099-a571-3d8403630edd tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:47:08.343833 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-27f1ce2e-568c-4099-a571-3d8403630edd tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] [instance: dd66096c-0b64-4a26-bdec-1b1a46310cfb] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:08.349487 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-27f1ce2e-568c-4099-a571-3d8403630edd tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:08.349970 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-27f1ce2e-568c-4099-a571-3d8403630edd tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:08.350740 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-27f1ce2e-568c-4099-a571-3d8403630edd tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:08.351209 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-27f1ce2e-568c-4099-a571-3d8403630edd tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:08.577692 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-27f1ce2e-568c-4099-a571-3d8403630edd tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b983c0a2a124ac3aa3403e0777612f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0860b3d072246d49cd43a900351d571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:47:08.586307 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-27f1ce2e-568c-4099-a571-3d8403630edd tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] 10.222.0.64 "GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb" status: 200 len: 1574 microversion: 2.1 time: 0.252427 May 23 15:47:08.586943 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 307/635] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:47:08 2022] GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb => generated 1574 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:47:09.603915 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-71ac9036-8bc2-4896-a7b1-3b07a07d8357 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:47:09.604535 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-71ac9036-8bc2-4896-a7b1-3b07a07d8357 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] [instance: dd66096c-0b64-4a26-bdec-1b1a46310cfb] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:09.611322 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-71ac9036-8bc2-4896-a7b1-3b07a07d8357 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:09.611780 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-71ac9036-8bc2-4896-a7b1-3b07a07d8357 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:09.612541 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-71ac9036-8bc2-4896-a7b1-3b07a07d8357 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:09.612984 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-71ac9036-8bc2-4896-a7b1-3b07a07d8357 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:09.751753 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-71ac9036-8bc2-4896-a7b1-3b07a07d8357 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b983c0a2a124ac3aa3403e0777612f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0860b3d072246d49cd43a900351d571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:47:09.759368 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-71ac9036-8bc2-4896-a7b1-3b07a07d8357 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] 10.222.0.64 "GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb" status: 200 len: 1574 microversion: 2.1 time: 0.159285 May 23 15:47:09.760058 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 329/636] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:47:09 2022] GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:47:10.776739 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-260c3c3f-de07-4662-aa73-60a7dfda16ca tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:47:10.777360 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-260c3c3f-de07-4662-aa73-60a7dfda16ca tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] [instance: dd66096c-0b64-4a26-bdec-1b1a46310cfb] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:10.784073 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-260c3c3f-de07-4662-aa73-60a7dfda16ca tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:10.784524 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-260c3c3f-de07-4662-aa73-60a7dfda16ca tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:10.785325 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-260c3c3f-de07-4662-aa73-60a7dfda16ca tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:10.785761 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-260c3c3f-de07-4662-aa73-60a7dfda16ca tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:10.920924 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-260c3c3f-de07-4662-aa73-60a7dfda16ca tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b983c0a2a124ac3aa3403e0777612f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0860b3d072246d49cd43a900351d571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:47:10.928948 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-260c3c3f-de07-4662-aa73-60a7dfda16ca tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] 10.222.0.64 "GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb" status: 200 len: 1574 microversion: 2.1 time: 0.156165 May 23 15:47:10.929547 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 308/637] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:47:10 2022] GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:47:11.947295 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-c3fc19e5-63bc-43a1-9dbe-3ecf2ea3b574 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:47:11.948473 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-c3fc19e5-63bc-43a1-9dbe-3ecf2ea3b574 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] [instance: dd66096c-0b64-4a26-bdec-1b1a46310cfb] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:11.955712 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-c3fc19e5-63bc-43a1-9dbe-3ecf2ea3b574 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:11.956482 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-c3fc19e5-63bc-43a1-9dbe-3ecf2ea3b574 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:11.957330 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-c3fc19e5-63bc-43a1-9dbe-3ecf2ea3b574 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:11.957767 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-c3fc19e5-63bc-43a1-9dbe-3ecf2ea3b574 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:12.125348 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-c3fc19e5-63bc-43a1-9dbe-3ecf2ea3b574 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b983c0a2a124ac3aa3403e0777612f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0860b3d072246d49cd43a900351d571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:47:12.133758 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-c3fc19e5-63bc-43a1-9dbe-3ecf2ea3b574 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] 10.222.0.64 "GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb" status: 200 len: 1574 microversion: 2.1 time: 0.190665 May 23 15:47:12.134544 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 330/638] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:47:11 2022] GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb => generated 1574 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:47:13.152723 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-08d1947c-2682-487a-97d0-5bab9e128e1e tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:47:13.153439 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-08d1947c-2682-487a-97d0-5bab9e128e1e tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] [instance: dd66096c-0b64-4a26-bdec-1b1a46310cfb] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:13.156025 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_api:SELECT=65 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:47:13.163802 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-08d1947c-2682-487a-97d0-5bab9e128e1e tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:13.166869 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-08d1947c-2682-487a-97d0-5bab9e128e1e tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:13.166869 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-08d1947c-2682-487a-97d0-5bab9e128e1e tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:13.166869 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-08d1947c-2682-487a-97d0-5bab9e128e1e tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:13.424440 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-08d1947c-2682-487a-97d0-5bab9e128e1e tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b983c0a2a124ac3aa3403e0777612f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0860b3d072246d49cd43a900351d571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:47:13.431340 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-08d1947c-2682-487a-97d0-5bab9e128e1e tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] 10.222.0.64 "GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb" status: 200 len: 1574 microversion: 2.1 time: 0.282826 May 23 15:47:13.432116 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 309/639] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:47:13 2022] GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb => generated 1574 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:47:14.449013 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-450ed4ed-b922-4cee-9cbd-efe2a9058dc0 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:47:14.450502 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-450ed4ed-b922-4cee-9cbd-efe2a9058dc0 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] [instance: dd66096c-0b64-4a26-bdec-1b1a46310cfb] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:14.457821 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-450ed4ed-b922-4cee-9cbd-efe2a9058dc0 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:14.458366 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-450ed4ed-b922-4cee-9cbd-efe2a9058dc0 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:14.459217 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-450ed4ed-b922-4cee-9cbd-efe2a9058dc0 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:14.459662 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-450ed4ed-b922-4cee-9cbd-efe2a9058dc0 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:14.730363 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-450ed4ed-b922-4cee-9cbd-efe2a9058dc0 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b983c0a2a124ac3aa3403e0777612f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0860b3d072246d49cd43a900351d571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:47:14.738385 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-450ed4ed-b922-4cee-9cbd-efe2a9058dc0 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] 10.222.0.64 "GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb" status: 200 len: 1574 microversion: 2.1 time: 0.293375 May 23 15:47:14.742904 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 331/640] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:47:14 2022] GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb => generated 1574 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:47:15.254982 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-c345c21a-430a-4a2e-b00a-f308b0f8a04e tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Action: 'create', calling method: .version_select at 0x7fab51ddfa60>, body: {"keypair": {"name": "tempest-keypair-1875959502", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP8MSIcgiM8k7GfWM/XJwjPMaVPZdLh0JF+omKEe74Bu0KW3LkVGpiKHhyF81hJne8vm3rfaduleJ+ib2yYluFi43o6B7b3UL+3GIwlG28WXTocpCDoiceLUPk3/hpLfJg=="}} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:47:15.269303 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.quota [None req-c345c21a-430a-4a2e-b00a-f308b0f8a04e tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Getting quotas for project 749e4849b23b4e42be64ef0ab0330a0b. Resources: {'key_pairs'} {{(pid=124933) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 15:47:15.273041 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.quota [None req-c345c21a-430a-4a2e-b00a-f308b0f8a04e tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Getting quotas for user 7a5fc191f3464ffe83d5fde2419cb8b4 and project 749e4849b23b4e42be64ef0ab0330a0b. Resources: {'key_pairs'} {{(pid=124933) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 15:47:15.334363 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-c345c21a-430a-4a2e-b00a-f308b0f8a04e tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.193265 May 23 15:47:15.334963 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 310/641] 10.222.0.64 () {62 vars in 1199 bytes} [Mon May 23 15:47:15 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 195 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 23 15:47:15.756232 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-9d307ad1-c1dd-4a91-aadd-04c378a37c3c tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:47:15.756876 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-9d307ad1-c1dd-4a91-aadd-04c378a37c3c tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] [instance: dd66096c-0b64-4a26-bdec-1b1a46310cfb] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:15.763648 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-9d307ad1-c1dd-4a91-aadd-04c378a37c3c tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:15.765752 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-9d307ad1-c1dd-4a91-aadd-04c378a37c3c tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:15.766840 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-9d307ad1-c1dd-4a91-aadd-04c378a37c3c tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:15.767538 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-9d307ad1-c1dd-4a91-aadd-04c378a37c3c tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:15.793094 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:47:16.190031 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-9d307ad1-c1dd-4a91-aadd-04c378a37c3c tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b983c0a2a124ac3aa3403e0777612f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0860b3d072246d49cd43a900351d571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:47:16.198473 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-9d307ad1-c1dd-4a91-aadd-04c378a37c3c tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] 10.222.0.64 "GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb" status: 200 len: 1574 microversion: 2.1 time: 0.446472 May 23 15:47:16.199055 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 332/642] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:47:15 2022] GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb => generated 1574 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:47:17.217700 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-0d34d137-363d-479f-a1cd-1062c62dabea tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:47:17.218341 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-0d34d137-363d-479f-a1cd-1062c62dabea tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] [instance: dd66096c-0b64-4a26-bdec-1b1a46310cfb] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:17.225670 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-0d34d137-363d-479f-a1cd-1062c62dabea tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:17.226129 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-0d34d137-363d-479f-a1cd-1062c62dabea tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:17.226915 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-0d34d137-363d-479f-a1cd-1062c62dabea tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:17.227356 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-0d34d137-363d-479f-a1cd-1062c62dabea tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:17.404602 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-0d34d137-363d-479f-a1cd-1062c62dabea tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b983c0a2a124ac3aa3403e0777612f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0860b3d072246d49cd43a900351d571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:47:17.414093 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-0d34d137-363d-479f-a1cd-1062c62dabea tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] 10.222.0.64 "GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb" status: 200 len: 1574 microversion: 2.1 time: 0.200926 May 23 15:47:17.417104 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 311/643] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:47:17 2022] GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb => generated 1574 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:47:17.762606 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-667c0681-8d98-42d4-a660-cef12df935c7 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-535963845", "imageRef": "a5c8503f-3733-426f-8a5b-c7c9358e4a45", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8fb40c4e-9164-4617-9793-abd2286f1896"}], "security_groups": [{"name": "tempest-securitygroup--860657227"}], "key_name": "tempest-keypair-1875959502", "user_data": "}} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:47:17.869560 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.network.neutron [None req-667c0681-8d98-42d4-a660-cef12df935c7 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] validate_networks() for [('8fb40c4e-9164-4617-9793-abd2286f1896', None, None, None, None, None)] {{(pid=124934) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 15:47:18.307841 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.virt.hardware [None req-667c0681-8d98-42d4-a660-cef12df935c7 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Flavor limits 0:0:0 {{(pid=124934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 15:47:18.308587 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.virt.hardware [None req-667c0681-8d98-42d4-a660-cef12df935c7 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Image limits 0:0:0 {{(pid=124934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 15:47:18.309288 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.virt.hardware [None req-667c0681-8d98-42d4-a660-cef12df935c7 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Flavor pref 0:0:0 {{(pid=124934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 15:47:18.309712 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.virt.hardware [None req-667c0681-8d98-42d4-a660-cef12df935c7 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Image pref 0:0:0 {{(pid=124934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 15:47:18.310192 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.virt.hardware [None req-667c0681-8d98-42d4-a660-cef12df935c7 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 15:47:18.330519 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-667c0681-8d98-42d4-a660-cef12df935c7 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:18.331497 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-667c0681-8d98-42d4-a660-cef12df935c7 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:18.332798 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-667c0681-8d98-42d4-a660-cef12df935c7 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:18.333521 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-667c0681-8d98-42d4-a660-cef12df935c7 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:18.352975 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.quota [None req-667c0681-8d98-42d4-a660-cef12df935c7 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Getting quotas for project 749e4849b23b4e42be64ef0ab0330a0b. Resources: {'ram', 'instances', 'cores'} {{(pid=124934) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 15:47:18.357213 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.quota [None req-667c0681-8d98-42d4-a660-cef12df935c7 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Getting quotas for user 7a5fc191f3464ffe83d5fde2419cb8b4 and project 749e4849b23b4e42be64ef0ab0330a0b. Resources: {'ram', 'instances', 'cores'} {{(pid=124934) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 15:47:18.369898 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-667c0681-8d98-42d4-a660-cef12df935c7 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Going to run 1 instances... {{(pid=124934) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 15:47:18.372244 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-667c0681-8d98-42d4-a660-cef12df935c7 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5c8503f-3733-426f-8a5b-c7c9358e4a45',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124934) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 15:47:18.434375 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-01fdf3e0-e7a9-4edc-a394-54329efeeac0 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:47:18.434995 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-01fdf3e0-e7a9-4edc-a394-54329efeeac0 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] [instance: dd66096c-0b64-4a26-bdec-1b1a46310cfb] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:18.442574 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-01fdf3e0-e7a9-4edc-a394-54329efeeac0 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:18.448145 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-01fdf3e0-e7a9-4edc-a394-54329efeeac0 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:18.448145 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-01fdf3e0-e7a9-4edc-a394-54329efeeac0 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:18.448145 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-01fdf3e0-e7a9-4edc-a394-54329efeeac0 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:18.502290 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-667c0681-8d98-42d4-a660-cef12df935c7 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.745422 May 23 15:47:18.503591 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 333/644] 10.222.0.64 () {62 vars in 1187 bytes} [Mon May 23 15:47:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) May 23 15:47:18.520151 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-10a0e9ac-607e-45eb-ab98-846edd5e19ef tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:47:18.521113 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-10a0e9ac-607e-45eb-ab98-846edd5e19ef tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:18.606749 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-10a0e9ac-607e-45eb-ab98-846edd5e19ef tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:47:18.617045 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-10a0e9ac-607e-45eb-ab98-846edd5e19ef tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:47:18.619851 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-10a0e9ac-607e-45eb-ab98-846edd5e19ef tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:47:18.620977 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-10a0e9ac-607e-45eb-ab98-846edd5e19ef tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 200 len: 1281 microversion: 2.20 time: 0.108293 May 23 15:47:18.621574 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 334/645] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:47:18 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 1281 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:47:18.654045 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-01fdf3e0-e7a9-4edc-a394-54329efeeac0 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b983c0a2a124ac3aa3403e0777612f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0860b3d072246d49cd43a900351d571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:47:18.662991 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-01fdf3e0-e7a9-4edc-a394-54329efeeac0 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] 10.222.0.64 "GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb" status: 200 len: 1574 microversion: 2.1 time: 0.232814 May 23 15:47:18.663688 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 312/646] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:47:18 2022] GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb => generated 1574 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:47:19.447265 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [req-52afd221-05d5-435d-872b-4906b296cbfb req-08324ee1-2755-4c4f-97f5-a87d83a33bb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd66096c-0b64-4a26-bdec-1b1a46310cfb", "name": "network-vif-plugged", "status": "completed", "tag": "a0610243-2466-4315-a3e6-15f6cea816b8"}]} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:47:19.456500 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-52afd221-05d5-435d-872b-4906b296cbfb req-08324ee1-2755-4c4f-97f5-a87d83a33bb7 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:19.456940 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-52afd221-05d5-435d-872b-4906b296cbfb req-08324ee1-2755-4c4f-97f5-a87d83a33bb7 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:19.466715 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.compute.server_external_events [req-52afd221-05d5-435d-872b-4906b296cbfb req-08324ee1-2755-4c4f-97f5-a87d83a33bb7 service nova] Creating event network-vif-plugged:a0610243-2466-4315-a3e6-15f6cea816b8 for instance dd66096c-0b64-4a26-bdec-1b1a46310cfb on hv-cinder-84067 May 23 15:47:19.471710 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [req-52afd221-05d5-435d-872b-4906b296cbfb req-08324ee1-2755-4c4f-97f5-a87d83a33bb7 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087384 May 23 15:47:19.472267 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 335/647] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:47:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:47:19.640175 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-a174d9a7-2eb9-4cfe-ae55-3808cbd1fa88 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:47:19.640782 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-a174d9a7-2eb9-4cfe-ae55-3808cbd1fa88 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:19.647300 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a174d9a7-2eb9-4cfe-ae55-3808cbd1fa88 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:19.647744 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a174d9a7-2eb9-4cfe-ae55-3808cbd1fa88 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:19.648497 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a174d9a7-2eb9-4cfe-ae55-3808cbd1fa88 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:19.648927 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a174d9a7-2eb9-4cfe-ae55-3808cbd1fa88 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:19.681214 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-2b9044af-fb4c-4a1f-bb68-8da54bca1a80 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:47:19.682020 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-2b9044af-fb4c-4a1f-bb68-8da54bca1a80 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] [instance: dd66096c-0b64-4a26-bdec-1b1a46310cfb] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:19.689160 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2b9044af-fb4c-4a1f-bb68-8da54bca1a80 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:19.689748 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2b9044af-fb4c-4a1f-bb68-8da54bca1a80 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:19.690602 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2b9044af-fb4c-4a1f-bb68-8da54bca1a80 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:19.691115 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2b9044af-fb4c-4a1f-bb68-8da54bca1a80 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:19.759599 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-a174d9a7-2eb9-4cfe-ae55-3808cbd1fa88 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:47:19.767787 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-a174d9a7-2eb9-4cfe-ae55-3808cbd1fa88 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:47:19.769607 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-a174d9a7-2eb9-4cfe-ae55-3808cbd1fa88 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:47:19.770963 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-a174d9a7-2eb9-4cfe-ae55-3808cbd1fa88 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 200 len: 1285 microversion: 2.20 time: 0.135893 May 23 15:47:19.771519 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 313/648] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:47:19 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 1285 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:47:19.865973 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-2b9044af-fb4c-4a1f-bb68-8da54bca1a80 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b983c0a2a124ac3aa3403e0777612f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0860b3d072246d49cd43a900351d571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:47:19.875942 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-2b9044af-fb4c-4a1f-bb68-8da54bca1a80 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] 10.222.0.64 "GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb" status: 200 len: 1574 microversion: 2.1 time: 0.198901 May 23 15:47:19.882035 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 336/649] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:47:19 2022] GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb => generated 1574 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:47:20.789375 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-634187d8-ee93-43ee-ac33-1a8975ca6f07 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:47:20.789986 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-634187d8-ee93-43ee-ac33-1a8975ca6f07 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:20.796719 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-634187d8-ee93-43ee-ac33-1a8975ca6f07 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:20.797519 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-634187d8-ee93-43ee-ac33-1a8975ca6f07 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:20.797976 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-634187d8-ee93-43ee-ac33-1a8975ca6f07 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:20.798446 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-634187d8-ee93-43ee-ac33-1a8975ca6f07 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:20.860165 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-634187d8-ee93-43ee-ac33-1a8975ca6f07 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:47:20.868215 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-634187d8-ee93-43ee-ac33-1a8975ca6f07 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:47:20.869768 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-634187d8-ee93-43ee-ac33-1a8975ca6f07 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:47:20.870873 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-634187d8-ee93-43ee-ac33-1a8975ca6f07 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 200 len: 1333 microversion: 2.20 time: 0.085511 May 23 15:47:20.871426 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 314/650] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:47:20 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 1333 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:47:20.894244 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-141a53fd-1143-42b6-9e9f-c16fad2ab63b tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:47:20.894872 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-141a53fd-1143-42b6-9e9f-c16fad2ab63b tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] [instance: dd66096c-0b64-4a26-bdec-1b1a46310cfb] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:20.900892 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-141a53fd-1143-42b6-9e9f-c16fad2ab63b tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:20.901377 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-141a53fd-1143-42b6-9e9f-c16fad2ab63b tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:20.902140 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-141a53fd-1143-42b6-9e9f-c16fad2ab63b tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:20.902578 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-141a53fd-1143-42b6-9e9f-c16fad2ab63b tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:21.035610 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-141a53fd-1143-42b6-9e9f-c16fad2ab63b tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b983c0a2a124ac3aa3403e0777612f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0860b3d072246d49cd43a900351d571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:47:21.043235 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-141a53fd-1143-42b6-9e9f-c16fad2ab63b tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] 10.222.0.64 "GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb" status: 200 len: 1574 microversion: 2.1 time: 0.152861 May 23 15:47:21.043797 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 337/651] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:47:20 2022] GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:47:21.890915 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-fe2f2c8b-8601-4fe2-a9f0-2f9bd9cd21b5 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:47:21.892170 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-fe2f2c8b-8601-4fe2-a9f0-2f9bd9cd21b5 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:21.899857 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-fe2f2c8b-8601-4fe2-a9f0-2f9bd9cd21b5 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:21.901934 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-fe2f2c8b-8601-4fe2-a9f0-2f9bd9cd21b5 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:21.901934 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-fe2f2c8b-8601-4fe2-a9f0-2f9bd9cd21b5 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:21.901934 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-fe2f2c8b-8601-4fe2-a9f0-2f9bd9cd21b5 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:21.985640 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-fe2f2c8b-8601-4fe2-a9f0-2f9bd9cd21b5 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:47:21.994347 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-fe2f2c8b-8601-4fe2-a9f0-2f9bd9cd21b5 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:47:21.995869 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-fe2f2c8b-8601-4fe2-a9f0-2f9bd9cd21b5 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:47:21.997191 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-fe2f2c8b-8601-4fe2-a9f0-2f9bd9cd21b5 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 200 len: 1341 microversion: 2.20 time: 0.111360 May 23 15:47:21.997750 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 315/652] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:47:21 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 1341 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:47:22.059718 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-debe6280-4c50-4b05-9c3a-4d99c388aebc tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:47:22.060344 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-debe6280-4c50-4b05-9c3a-4d99c388aebc tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] [instance: dd66096c-0b64-4a26-bdec-1b1a46310cfb] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:22.066377 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-debe6280-4c50-4b05-9c3a-4d99c388aebc tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:22.066834 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-debe6280-4c50-4b05-9c3a-4d99c388aebc tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:22.067612 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-debe6280-4c50-4b05-9c3a-4d99c388aebc tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:22.068053 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-debe6280-4c50-4b05-9c3a-4d99c388aebc tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:22.271545 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-debe6280-4c50-4b05-9c3a-4d99c388aebc tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b983c0a2a124ac3aa3403e0777612f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0860b3d072246d49cd43a900351d571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:47:22.279066 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-debe6280-4c50-4b05-9c3a-4d99c388aebc tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] 10.222.0.64 "GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb" status: 200 len: 1561 microversion: 2.1 time: 0.223276 May 23 15:47:22.279731 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 338/653] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:47:22 2022] GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb => generated 1561 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:47:23.016237 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-8f943eb5-39fe-41bd-9bef-ebc2e2dc3a3b tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:47:23.016853 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-8f943eb5-39fe-41bd-9bef-ebc2e2dc3a3b tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:23.024476 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-8f943eb5-39fe-41bd-9bef-ebc2e2dc3a3b tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:23.029128 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-8f943eb5-39fe-41bd-9bef-ebc2e2dc3a3b tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:23.029128 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-8f943eb5-39fe-41bd-9bef-ebc2e2dc3a3b tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:23.029128 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-8f943eb5-39fe-41bd-9bef-ebc2e2dc3a3b tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:23.275068 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-8f943eb5-39fe-41bd-9bef-ebc2e2dc3a3b tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:47:23.283047 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-8f943eb5-39fe-41bd-9bef-ebc2e2dc3a3b tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:47:23.284617 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-8f943eb5-39fe-41bd-9bef-ebc2e2dc3a3b tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:47:23.285766 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-8f943eb5-39fe-41bd-9bef-ebc2e2dc3a3b tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 200 len: 1406 microversion: 2.20 time: 0.274142 May 23 15:47:23.286334 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 316/654] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:47:23 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 1406 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:47:23.852253 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [req-68f0e345-d02b-4b5b-be71-25d4a0f13ad6 req-4ec6b672-23ea-4109-9ab0-c2ab713bea8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d9a9391-45aa-4e87-b025-839d2bf5c8a3", "tag": "9f19c00b-8184-4f9a-bd54-44e27e1f300a"}]} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:47:23.861516 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-68f0e345-d02b-4b5b-be71-25d4a0f13ad6 req-4ec6b672-23ea-4109-9ab0-c2ab713bea8b service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:23.861973 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-68f0e345-d02b-4b5b-be71-25d4a0f13ad6 req-4ec6b672-23ea-4109-9ab0-c2ab713bea8b service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:23.873991 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.compute.server_external_events [req-68f0e345-d02b-4b5b-be71-25d4a0f13ad6 req-4ec6b672-23ea-4109-9ab0-c2ab713bea8b service nova] Creating event network-changed:9f19c00b-8184-4f9a-bd54-44e27e1f300a for instance 9d9a9391-45aa-4e87-b025-839d2bf5c8a3 on hv-cinder-84067 May 23 15:47:23.879020 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [req-68f0e345-d02b-4b5b-be71-25d4a0f13ad6 req-4ec6b672-23ea-4109-9ab0-c2ab713bea8b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094011 May 23 15:47:23.879600 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 339/655] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:47:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:47:24.304025 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-2d0aa39e-3abe-4d63-9366-c682be0390a5 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:47:24.308877 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-2d0aa39e-3abe-4d63-9366-c682be0390a5 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:24.312332 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-2d0aa39e-3abe-4d63-9366-c682be0390a5 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:24.312798 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-2d0aa39e-3abe-4d63-9366-c682be0390a5 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:24.313644 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-2d0aa39e-3abe-4d63-9366-c682be0390a5 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:24.314092 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-2d0aa39e-3abe-4d63-9366-c682be0390a5 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:24.318409 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_cell1:SELECT=100 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:47:24.456023 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-2d0aa39e-3abe-4d63-9366-c682be0390a5 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:47:24.464827 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-2d0aa39e-3abe-4d63-9366-c682be0390a5 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:47:24.467648 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-2d0aa39e-3abe-4d63-9366-c682be0390a5 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:47:24.468272 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-2d0aa39e-3abe-4d63-9366-c682be0390a5 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 200 len: 1406 microversion: 2.20 time: 0.168149 May 23 15:47:24.468845 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 317/656] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:47:24 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:47:25.196406 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-166d0629-c9f1-42d7-8c90-f9081178c33b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:47:25.196987 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-166d0629-c9f1-42d7-8c90-f9081178c33b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 53a161fc-db24-4861-8e60-b1e29465366e] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:25.203373 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-166d0629-c9f1-42d7-8c90-f9081178c33b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:25.203818 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-166d0629-c9f1-42d7-8c90-f9081178c33b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:25.204619 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-166d0629-c9f1-42d7-8c90-f9081178c33b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:25.205070 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-166d0629-c9f1-42d7-8c90-f9081178c33b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:25.227408 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-166d0629-c9f1-42d7-8c90-f9081178c33b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e/ips" status: 200 len: 145 microversion: 2.1 time: 0.135446 May 23 15:47:25.227994 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 340/657] 10.222.0.64 () {58 vars in 1247 bytes} [Mon May 23 15:47:25 2022] GET /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e/ips => generated 145 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:47:25.486906 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-430c9a3b-d995-402c-940d-d246bddf4ba0 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:47:25.487588 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-430c9a3b-d995-402c-940d-d246bddf4ba0 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:25.490535 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_cell0:SELECT=4 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:47:25.494559 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-430c9a3b-d995-402c-940d-d246bddf4ba0 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:25.495010 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-430c9a3b-d995-402c-940d-d246bddf4ba0 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:25.495808 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-430c9a3b-d995-402c-940d-d246bddf4ba0 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:25.496244 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-430c9a3b-d995-402c-940d-d246bddf4ba0 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:25.728318 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-430c9a3b-d995-402c-940d-d246bddf4ba0 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:47:25.737305 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-430c9a3b-d995-402c-940d-d246bddf4ba0 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:47:25.739477 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-430c9a3b-d995-402c-940d-d246bddf4ba0 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:47:25.740606 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-430c9a3b-d995-402c-940d-d246bddf4ba0 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 200 len: 1406 microversion: 2.20 time: 0.258348 May 23 15:47:25.741190 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 318/658] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:47:25 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 1406 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:47:26.758408 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-f82a6988-eaa3-448b-80af-7d7aac248cd2 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:47:26.758970 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-f82a6988-eaa3-448b-80af-7d7aac248cd2 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:26.765681 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-f82a6988-eaa3-448b-80af-7d7aac248cd2 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:26.766126 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-f82a6988-eaa3-448b-80af-7d7aac248cd2 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:26.766879 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-f82a6988-eaa3-448b-80af-7d7aac248cd2 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:26.767310 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-f82a6988-eaa3-448b-80af-7d7aac248cd2 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:26.827877 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-ab6449de-c55b-4bbf-8c2b-306d6ad20eb0 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e8b411cd-e89c-4e5c-81bc-8938979d800c"}} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:47:26.829110 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-ab6449de-c55b-4bbf-8c2b-306d6ad20eb0 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 53a161fc-db24-4861-8e60-b1e29465366e] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:26.836516 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ab6449de-c55b-4bbf-8c2b-306d6ad20eb0 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:26.836968 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ab6449de-c55b-4bbf-8c2b-306d6ad20eb0 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:26.837768 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ab6449de-c55b-4bbf-8c2b-306d6ad20eb0 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:26.838200 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ab6449de-c55b-4bbf-8c2b-306d6ad20eb0 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:26.905373 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-f82a6988-eaa3-448b-80af-7d7aac248cd2 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:47:26.913469 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-f82a6988-eaa3-448b-80af-7d7aac248cd2 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:47:26.914982 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-f82a6988-eaa3-448b-80af-7d7aac248cd2 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:47:26.916104 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-f82a6988-eaa3-448b-80af-7d7aac248cd2 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 200 len: 1406 microversion: 2.20 time: 0.161665 May 23 15:47:26.916649 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 341/659] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:47:26 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:47:27.844699 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-ab6449de-c55b-4bbf-8c2b-306d6ad20eb0 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "POST /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.021260 May 23 15:47:27.845266 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 319/660] 10.222.0.64 () {60 vars in 1322 bytes} [Mon May 23 15:47:26 2022] POST /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e/os-volume_attachments => generated 194 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:47:27.935188 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-97eb153b-94a7-4945-b177-a933a24e70ef tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:47:27.936400 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-97eb153b-94a7-4945-b177-a933a24e70ef tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:27.942731 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-97eb153b-94a7-4945-b177-a933a24e70ef tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:27.943788 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-97eb153b-94a7-4945-b177-a933a24e70ef tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:27.944844 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-97eb153b-94a7-4945-b177-a933a24e70ef tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:27.945313 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-97eb153b-94a7-4945-b177-a933a24e70ef tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:28.078144 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-97eb153b-94a7-4945-b177-a933a24e70ef tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:47:28.086721 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-97eb153b-94a7-4945-b177-a933a24e70ef tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:47:28.088302 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-97eb153b-94a7-4945-b177-a933a24e70ef tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:47:28.089445 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-97eb153b-94a7-4945-b177-a933a24e70ef tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 200 len: 1406 microversion: 2.20 time: 0.158295 May 23 15:47:28.090059 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 342/661] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:47:27 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:47:29.108206 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-5987746b-c054-4f55-b867-c14fe3fd4aa9 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:47:29.108897 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-5987746b-c054-4f55-b867-c14fe3fd4aa9 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:29.115677 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-5987746b-c054-4f55-b867-c14fe3fd4aa9 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:29.116133 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-5987746b-c054-4f55-b867-c14fe3fd4aa9 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:29.116896 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-5987746b-c054-4f55-b867-c14fe3fd4aa9 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:29.117359 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-5987746b-c054-4f55-b867-c14fe3fd4aa9 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:29.252415 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-5987746b-c054-4f55-b867-c14fe3fd4aa9 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:47:29.260983 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-5987746b-c054-4f55-b867-c14fe3fd4aa9 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:47:29.262510 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-5987746b-c054-4f55-b867-c14fe3fd4aa9 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:47:29.264379 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-5987746b-c054-4f55-b867-c14fe3fd4aa9 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 200 len: 1406 microversion: 2.20 time: 0.159688 May 23 15:47:29.265347 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 320/662] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:47:29 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:47:29.560468 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [req-5c9804b3-9940-467d-be52-26a3dc8e80e2 req-7d2ea6a2-cd4e-4ca7-b71e-8557f8b2b66d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d9a9391-45aa-4e87-b025-839d2bf5c8a3", "name": "network-vif-plugged", "status": "completed", "tag": "9f19c00b-8184-4f9a-bd54-44e27e1f300a"}]} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:47:29.564626 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_cell0:SELECT=2 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:47:29.565531 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_cell0:SELECT=8 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:47:29.570663 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-5c9804b3-9940-467d-be52-26a3dc8e80e2 req-7d2ea6a2-cd4e-4ca7-b71e-8557f8b2b66d service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:29.571103 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-5c9804b3-9940-467d-be52-26a3dc8e80e2 req-7d2ea6a2-cd4e-4ca7-b71e-8557f8b2b66d service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:29.582687 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.compute.server_external_events [req-5c9804b3-9940-467d-be52-26a3dc8e80e2 req-7d2ea6a2-cd4e-4ca7-b71e-8557f8b2b66d service nova] Creating event network-vif-plugged:9f19c00b-8184-4f9a-bd54-44e27e1f300a for instance 9d9a9391-45aa-4e87-b025-839d2bf5c8a3 on hv-cinder-84067 May 23 15:47:29.587538 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [req-5c9804b3-9940-467d-be52-26a3dc8e80e2 req-7d2ea6a2-cd4e-4ca7-b71e-8557f8b2b66d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030775 May 23 15:47:29.588106 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 343/663] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:47:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:47:30.282779 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-2367c0ab-dac9-4039-9192-2736f0bb5495 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:47:30.283391 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-2367c0ab-dac9-4039-9192-2736f0bb5495 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:30.289977 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-2367c0ab-dac9-4039-9192-2736f0bb5495 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:30.290421 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-2367c0ab-dac9-4039-9192-2736f0bb5495 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:30.291177 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-2367c0ab-dac9-4039-9192-2736f0bb5495 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:30.291612 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-2367c0ab-dac9-4039-9192-2736f0bb5495 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:30.467948 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-2367c0ab-dac9-4039-9192-2736f0bb5495 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:47:30.476460 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-2367c0ab-dac9-4039-9192-2736f0bb5495 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:47:30.478016 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-2367c0ab-dac9-4039-9192-2736f0bb5495 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:47:30.479134 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-2367c0ab-dac9-4039-9192-2736f0bb5495 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 200 len: 1406 microversion: 2.20 time: 0.200401 May 23 15:47:30.479697 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 321/664] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:47:30 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 1406 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:47:31.498791 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-d69010b4-c7e5-4c2d-b6df-214ed5b55689 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:47:31.499596 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-d69010b4-c7e5-4c2d-b6df-214ed5b55689 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:31.506343 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-d69010b4-c7e5-4c2d-b6df-214ed5b55689 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:31.506790 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-d69010b4-c7e5-4c2d-b6df-214ed5b55689 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:31.507540 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-d69010b4-c7e5-4c2d-b6df-214ed5b55689 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:31.507974 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-d69010b4-c7e5-4c2d-b6df-214ed5b55689 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:31.689936 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-1b6e06a6-c9fb-44dc-b4b4-ff3aeef5efff tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:47:31.690449 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-1b6e06a6-c9fb-44dc-b4b4-ff3aeef5efff tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 8393c1a9-60d1-4b54-947d-3ef1a2e56845] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:31.693670 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-d69010b4-c7e5-4c2d-b6df-214ed5b55689 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:47:31.697042 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1b6e06a6-c9fb-44dc-b4b4-ff3aeef5efff tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:31.697524 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1b6e06a6-c9fb-44dc-b4b4-ff3aeef5efff tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:31.698299 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1b6e06a6-c9fb-44dc-b4b4-ff3aeef5efff tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:31.698738 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1b6e06a6-c9fb-44dc-b4b4-ff3aeef5efff tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:31.704374 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-d69010b4-c7e5-4c2d-b6df-214ed5b55689 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:47:31.705918 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-d69010b4-c7e5-4c2d-b6df-214ed5b55689 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:47:31.721980 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-d69010b4-c7e5-4c2d-b6df-214ed5b55689 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 200 len: 1406 microversion: 2.20 time: 0.212919 May 23 15:47:31.721980 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 344/665] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:47:31 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 1406 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:47:31.724787 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-1b6e06a6-c9fb-44dc-b4b4-ff3aeef5efff tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845/ips" status: 200 len: 151 microversion: 2.1 time: 0.038898 May 23 15:47:31.725390 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 322/666] 10.222.0.64 () {58 vars in 1247 bytes} [Mon May 23 15:47:31 2022] GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:47:32.738636 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-85b472a0-de9e-4953-acb1-9f145179bb1d tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:47:32.739251 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-85b472a0-de9e-4953-acb1-9f145179bb1d tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:32.745236 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-85b472a0-de9e-4953-acb1-9f145179bb1d tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:32.745688 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-85b472a0-de9e-4953-acb1-9f145179bb1d tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:32.746449 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-85b472a0-de9e-4953-acb1-9f145179bb1d tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:32.746886 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-85b472a0-de9e-4953-acb1-9f145179bb1d tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:32.875642 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-85b472a0-de9e-4953-acb1-9f145179bb1d tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:47:32.883516 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-85b472a0-de9e-4953-acb1-9f145179bb1d tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:47:32.885107 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-85b472a0-de9e-4953-acb1-9f145179bb1d tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:47:32.886263 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-85b472a0-de9e-4953-acb1-9f145179bb1d tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 200 len: 1598 microversion: 2.20 time: 0.151489 May 23 15:47:32.886812 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 345/667] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:47:32 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 1598 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:47:32.903675 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-3f222393-4be0-469b-a42d-5e4d5414f73e tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:47:32.904232 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-3f222393-4be0-469b-a42d-5e4d5414f73e tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:32.911151 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-3f222393-4be0-469b-a42d-5e4d5414f73e tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:32.913108 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-3f222393-4be0-469b-a42d-5e4d5414f73e tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:32.913108 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-3f222393-4be0-469b-a42d-5e4d5414f73e tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:32.913108 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-3f222393-4be0-469b-a42d-5e4d5414f73e tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:32.993493 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-3f222393-4be0-469b-a42d-5e4d5414f73e tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.093619 May 23 15:47:32.994096 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 323/668] 10.222.0.64 () {60 vars in 1315 bytes} [Mon May 23 15:47:32 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 15:47:33.223222 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-2d68ef76-6cb6-4a6b-bfa6-7995e0377ffb tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cb568a31-7c69-4955-995a-2a9f900e7280"}} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:47:33.224326 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-2d68ef76-6cb6-4a6b-bfa6-7995e0377ffb tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 8393c1a9-60d1-4b54-947d-3ef1a2e56845] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:33.231617 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2d68ef76-6cb6-4a6b-bfa6-7995e0377ffb tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:33.232071 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2d68ef76-6cb6-4a6b-bfa6-7995e0377ffb tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:33.232852 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2d68ef76-6cb6-4a6b-bfa6-7995e0377ffb tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:33.234391 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2d68ef76-6cb6-4a6b-bfa6-7995e0377ffb tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:34.205902 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-2d68ef76-6cb6-4a6b-bfa6-7995e0377ffb tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "POST /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.980376 May 23 15:47:34.205902 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 346/669] 10.222.0.64 () {60 vars in 1322 bytes} [Mon May 23 15:47:33 2022] POST /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845/os-volume_attachments => generated 194 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:47:34.270433 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [req-a8732682-d586-4dcd-ad13-4ee4a779cfb4 req-538d3f2d-1ac9-491b-b2f7-1d18ce259e42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d9a9391-45aa-4e87-b025-839d2bf5c8a3", "tag": "9f19c00b-8184-4f9a-bd54-44e27e1f300a"}]} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:47:34.280489 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-a8732682-d586-4dcd-ad13-4ee4a779cfb4 req-538d3f2d-1ac9-491b-b2f7-1d18ce259e42 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:34.281079 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-a8732682-d586-4dcd-ad13-4ee4a779cfb4 req-538d3f2d-1ac9-491b-b2f7-1d18ce259e42 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:34.293733 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.compute.server_external_events [req-a8732682-d586-4dcd-ad13-4ee4a779cfb4 req-538d3f2d-1ac9-491b-b2f7-1d18ce259e42 service nova] Creating event network-changed:9f19c00b-8184-4f9a-bd54-44e27e1f300a for instance 9d9a9391-45aa-4e87-b025-839d2bf5c8a3 on hv-cinder-84067 May 23 15:47:34.299461 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [req-a8732682-d586-4dcd-ad13-4ee4a779cfb4 req-538d3f2d-1ac9-491b-b2f7-1d18ce259e42 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089731 May 23 15:47:34.300161 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 324/670] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:47:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:47:36.463536 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-704a4011-1a98-464d-8da6-fe5861709c8a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:47:36.464604 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-704a4011-1a98-464d-8da6-fe5861709c8a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 53a161fc-db24-4861-8e60-b1e29465366e] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:36.466513 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:47:36.471999 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-704a4011-1a98-464d-8da6-fe5861709c8a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:36.472445 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-704a4011-1a98-464d-8da6-fe5861709c8a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:36.473273 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-704a4011-1a98-464d-8da6-fe5861709c8a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:36.473707 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-704a4011-1a98-464d-8da6-fe5861709c8a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:36.503148 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-704a4011-1a98-464d-8da6-fe5861709c8a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044278 May 23 15:47:36.503621 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 347/671] 10.222.0.64 () {58 vars in 1301 bytes} [Mon May 23 15:47:36 2022] GET /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:47:36.513956 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-e376d451-a3f4-427b-9095-dc8bd9fa932e tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:47:36.514550 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-e376d451-a3f4-427b-9095-dc8bd9fa932e tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 53a161fc-db24-4861-8e60-b1e29465366e] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:36.521649 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e376d451-a3f4-427b-9095-dc8bd9fa932e tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:36.522097 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e376d451-a3f4-427b-9095-dc8bd9fa932e tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:36.522866 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e376d451-a3f4-427b-9095-dc8bd9fa932e tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:36.523294 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e376d451-a3f4-427b-9095-dc8bd9fa932e tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:36.552087 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-e376d451-a3f4-427b-9095-dc8bd9fa932e tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e/os-volume_attachments/e8b411cd-e89c-4e5c-81bc-8938979d800c" status: 200 len: 194 microversion: 2.1 time: 0.042418 May 23 15:47:36.552694 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 325/672] 10.222.0.64 () {58 vars in 1412 bytes} [Mon May 23 15:47:36 2022] GET /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e/os-volume_attachments/e8b411cd-e89c-4e5c-81bc-8938979d800c => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:47:38.114878 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-e415faba-7ef9-4372-b08d-641d6c79d16b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5646beb0-13d1-46b5-a5c6-c99b6009e412"}} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:47:38.115940 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-e415faba-7ef9-4372-b08d-641d6c79d16b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 53a161fc-db24-4861-8e60-b1e29465366e] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:38.122598 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e415faba-7ef9-4372-b08d-641d6c79d16b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:38.123050 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e415faba-7ef9-4372-b08d-641d6c79d16b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:38.123820 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e415faba-7ef9-4372-b08d-641d6c79d16b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:38.124261 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e415faba-7ef9-4372-b08d-641d6c79d16b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:38.993185 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-e415faba-7ef9-4372-b08d-641d6c79d16b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "POST /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.883053 May 23 15:47:38.993795 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 348/673] 10.222.0.64 () {60 vars in 1322 bytes} [Mon May 23 15:47:38 2022] POST /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e/os-volume_attachments => generated 194 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:47:43.859937 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-717a4244-303b-4138-bd73-1f44f89927c6 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cb568a31-7c69-4955-995a-2a9f900e7280"}} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:47:43.861527 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-717a4244-303b-4138-bd73-1f44f89927c6 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 8393c1a9-60d1-4b54-947d-3ef1a2e56845] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:43.864014 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:47:43.869085 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-717a4244-303b-4138-bd73-1f44f89927c6 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:43.876450 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-717a4244-303b-4138-bd73-1f44f89927c6 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:43.876450 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-717a4244-303b-4138-bd73-1f44f89927c6 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:43.876450 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-717a4244-303b-4138-bd73-1f44f89927c6 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:43.949050 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.wsgi [None req-717a4244-303b-4138-bd73-1f44f89927c6 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] HTTP exception thrown: Invalid volume: volume cb568a31-7c69-4955-995a-2a9f900e7280 is already attached to instances: 8393c1a9-60d1-4b54-947d-3ef1a2e56845 May 23 15:47:43.950849 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-717a4244-303b-4138-bd73-1f44f89927c6 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Request method failure captured: May 23 15:47:43.950849 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: request: POST /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845/os-volume_attachments HTTP/1.1 May 23 15:47:43.950849 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Accept: application/json May 23 15:47:43.950849 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Accept-Encoding: identity May 23 15:47:43.950849 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Connection: close May 23 15:47:43.950849 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Content-Length: 74 May 23 15:47:43.950849 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Content-Type: application/json May 23 15:47:43.950849 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Host: 10.222.0.64 May 23 15:47:43.950849 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Openstack-System-Scope: None May 23 15:47:43.950849 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: User-Agent: python-urllib3/1.26.9 May 23 15:47:43.950849 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Auth-Token: gAAAAABii6uOGntB7Pc55mvjpSIsPzNLOlywCYGbr_-Vzy5_quOX_mjNj5PwEdU1U5x_QaGgk51iZzj3S4TZVzOIWCHWkRILSGjcG5ZDd1N2DadGTyYCWvrZ0p61UD6zAV5lw6yOUFVzzVm3KSoYQSF_ZlPFocwbQbQqnGoN6Tr34TmSqfoSNW8 May 23 15:47:43.950849 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Domain-Id: None May 23 15:47:43.950849 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Domain-Name: None May 23 15:47:43.950849 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Identity-Status: Confirmed May 23 15:47:43.950849 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Is-Admin-Project: True May 23 15:47:43.950849 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Domain-Id: default May 23 15:47:43.950849 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Domain-Name: Default May 23 15:47:43.950849 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Id: a15ae9d15a64468f80628ed51c2e42d6 May 23 15:47:43.950849 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Name: tempest-AttachVolumeNegativeTest-2009285566 May 23 15:47:43.950849 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Role: reader,member May 23 15:47:43.950849 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Roles: reader,member May 23 15:47:43.952486 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a15ae9d15a64468f80628ed51c2e42d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a15ae9d15a64468f80628ed51c2e42d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a15ae9d15a64468f80628ed51c2e42d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a15ae9d15a64468f80628ed51c2e42d6", "adminURL": "http://10.222.0.64:8080"}]}] May 23 15:47:43.952486 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant: tempest-AttachVolumeNegativeTest-2009285566 May 23 15:47:43.952486 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant-Id: a15ae9d15a64468f80628ed51c2e42d6 May 23 15:47:43.952486 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2009285566 May 23 15:47:43.952486 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User: tempest-AttachVolumeNegativeTest-2009285566-project May 23 15:47:43.952486 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Domain-Id: default May 23 15:47:43.952486 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Domain-Name: Default May 23 15:47:43.952486 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Id: 472049224bbf48699b8a9410ec61aa9e May 23 15:47:43.952486 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Name: tempest-AttachVolumeNegativeTest-2009285566-project May 23 15:47:43.952486 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: May 23 15:47:43.952486 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: {"volumeAttachment": {"volumeId": "cb568a31-7c69-4955-995a-2a9f900e7280"}} May 23 15:47:43.952486 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: method: > May 23 15:47:43.953537 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: exception: Invalid volume: volume cb568a31-7c69-4955-995a-2a9f900e7280 is already attached to instances: 8393c1a9-60d1-4b54-947d-3ef1a2e56845 May 23 15:47:43.953537 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: action_args: {'server_id': '8393c1a9-60d1-4b54-947d-3ef1a2e56845', 'body': {'volumeAttachment': {'volumeId': 'cb568a31-7c69-4955-995a-2a9f900e7280'}}} May 23 15:47:43.953537 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:47:43.953537 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:47:43.953537 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 23 15:47:43.953537 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 23 15:47:43.953537 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 23 15:47:43.953537 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 15:47:43.953537 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 23 15:47:43.953537 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 23 15:47:43.953537 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 23 15:47:43.953537 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 23 15:47:43.953537 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 23 15:47:43.953537 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 23 15:47:43.953537 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume cb568a31-7c69-4955-995a-2a9f900e7280 is already attached to instances: 8393c1a9-60d1-4b54-947d-3ef1a2e56845 May 23 15:47:43.953537 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:47:43.953537 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:47:43.953537 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:47:43.953537 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:47:43.955118 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:47:43.955118 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:47:43.955118 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:47:43.955118 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:47:43.955118 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:47:43.955118 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:47:43.955118 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 15:47:43.955118 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 15:47:43.955118 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 15:47:43.955118 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 15:47:43.955118 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 15:47:43.955118 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 15:47:43.955118 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 23 15:47:43.955118 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 23 15:47:43.955118 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume cb568a31-7c69-4955-995a-2a9f900e7280 is already attached to instances: 8393c1a9-60d1-4b54-947d-3ef1a2e56845 May 23 15:47:43.955118 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:47:43.955118 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:47:43.955118 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:47:43.955118 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:47:43.955118 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:47:43.956584 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:47:43.956584 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:47:43.956584 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:47:43.956584 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume cb568a31-7c69-4955-995a-2a9f900e7280 is already attached to instances: 8393c1a9-60d1-4b54-947d-3ef1a2e56845 May 23 15:47:43.956584 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:47:43.956584 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-717a4244-303b-4138-bd73-1f44f89927c6 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Returning 400 to user: Invalid volume: volume cb568a31-7c69-4955-995a-2a9f900e7280 is already attached to instances: 8393c1a9-60d1-4b54-947d-3ef1a2e56845 {{(pid=124933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:47:43.956584 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-717a4244-303b-4138-bd73-1f44f89927c6 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "POST /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096945 May 23 15:47:43.956584 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 326/674] 10.222.0.64 () {60 vars in 1322 bytes} [Mon May 23 15:47:43 2022] POST /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 23 15:47:44.014353 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-4d18ace7-71f1-4274-87e3-1feb9b80ca12 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:47:44.014940 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-4d18ace7-71f1-4274-87e3-1feb9b80ca12 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 8393c1a9-60d1-4b54-947d-3ef1a2e56845] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:44.021575 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4d18ace7-71f1-4274-87e3-1feb9b80ca12 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:44.022032 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4d18ace7-71f1-4274-87e3-1feb9b80ca12 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:44.022802 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4d18ace7-71f1-4274-87e3-1feb9b80ca12 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:44.023243 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4d18ace7-71f1-4274-87e3-1feb9b80ca12 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:44.103449 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.objects.instance [None req-4d18ace7-71f1-4274-87e3-1feb9b80ca12 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lazy-loading 'services' on Instance uuid 8393c1a9-60d1-4b54-947d-3ef1a2e56845 {{(pid=124934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 15:47:44.216862 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:47:44.291954 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-4d18ace7-71f1-4274-87e3-1feb9b80ca12 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "DELETE /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845/os-volume_attachments/cb568a31-7c69-4955-995a-2a9f900e7280" status: 202 len: 0 microversion: 2.1 time: 0.282364 May 23 15:47:44.292560 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 349/675] 10.222.0.64 () {58 vars in 1415 bytes} [Mon May 23 15:47:44 2022] DELETE /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845/os-volume_attachments/cb568a31-7c69-4955-995a-2a9f900e7280 => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 15:47:44.306223 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-a909c8e4-152f-4941-b0ed-a0751c7364d4 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:47:44.307295 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-a909c8e4-152f-4941-b0ed-a0751c7364d4 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 8393c1a9-60d1-4b54-947d-3ef1a2e56845] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:44.314162 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a909c8e4-152f-4941-b0ed-a0751c7364d4 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:44.314617 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a909c8e4-152f-4941-b0ed-a0751c7364d4 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:44.315552 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a909c8e4-152f-4941-b0ed-a0751c7364d4 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:44.315860 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a909c8e4-152f-4941-b0ed-a0751c7364d4 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:44.346340 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-a909c8e4-152f-4941-b0ed-a0751c7364d4 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049361 May 23 15:47:44.346887 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 327/676] 10.222.0.64 () {58 vars in 1301 bytes} [Mon May 23 15:47:44 2022] GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:47:45.358766 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-0e2c3a16-a5c3-4468-a7e5-e3b874c4ac79 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:47:45.360398 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-0e2c3a16-a5c3-4468-a7e5-e3b874c4ac79 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 8393c1a9-60d1-4b54-947d-3ef1a2e56845] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:45.367344 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0e2c3a16-a5c3-4468-a7e5-e3b874c4ac79 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:45.367801 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0e2c3a16-a5c3-4468-a7e5-e3b874c4ac79 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:45.368585 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0e2c3a16-a5c3-4468-a7e5-e3b874c4ac79 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:45.369027 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0e2c3a16-a5c3-4468-a7e5-e3b874c4ac79 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:45.400939 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-0e2c3a16-a5c3-4468-a7e5-e3b874c4ac79 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046819 May 23 15:47:45.401535 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 350/677] 10.222.0.64 () {58 vars in 1301 bytes} [Mon May 23 15:47:45 2022] GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:47:46.412595 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-d2eaac03-fe48-4196-a52c-2294a6515146 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:47:46.413563 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-d2eaac03-fe48-4196-a52c-2294a6515146 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 8393c1a9-60d1-4b54-947d-3ef1a2e56845] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:46.420017 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-d2eaac03-fe48-4196-a52c-2294a6515146 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:46.420474 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-d2eaac03-fe48-4196-a52c-2294a6515146 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:46.421339 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-d2eaac03-fe48-4196-a52c-2294a6515146 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:46.421790 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-d2eaac03-fe48-4196-a52c-2294a6515146 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:46.451069 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-d2eaac03-fe48-4196-a52c-2294a6515146 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042437 May 23 15:47:46.451617 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 328/678] 10.222.0.64 () {58 vars in 1301 bytes} [Mon May 23 15:47:46 2022] GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:47:47.463756 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-417c3595-ed6d-4a4b-bda0-6b669e4ca60a tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:47:47.464714 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-417c3595-ed6d-4a4b-bda0-6b669e4ca60a tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 8393c1a9-60d1-4b54-947d-3ef1a2e56845] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:47.472246 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-417c3595-ed6d-4a4b-bda0-6b669e4ca60a tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:47.472636 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-417c3595-ed6d-4a4b-bda0-6b669e4ca60a tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:47.473440 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-417c3595-ed6d-4a4b-bda0-6b669e4ca60a tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:47.473878 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-417c3595-ed6d-4a4b-bda0-6b669e4ca60a tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:47.503629 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-417c3595-ed6d-4a4b-bda0-6b669e4ca60a tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044212 May 23 15:47:47.504205 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 351/679] 10.222.0.64 () {58 vars in 1301 bytes} [Mon May 23 15:47:47 2022] GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:47:48.515143 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-db0f563f-be5e-4451-8f70-0d68ff6a5fd1 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:47:48.517101 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-db0f563f-be5e-4451-8f70-0d68ff6a5fd1 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 8393c1a9-60d1-4b54-947d-3ef1a2e56845] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:48.523650 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-db0f563f-be5e-4451-8f70-0d68ff6a5fd1 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:48.524102 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-db0f563f-be5e-4451-8f70-0d68ff6a5fd1 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:48.524869 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-db0f563f-be5e-4451-8f70-0d68ff6a5fd1 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:48.525346 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-db0f563f-be5e-4451-8f70-0d68ff6a5fd1 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:48.554083 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-db0f563f-be5e-4451-8f70-0d68ff6a5fd1 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042884 May 23 15:47:48.554626 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 329/680] 10.222.0.64 () {58 vars in 1301 bytes} [Mon May 23 15:47:48 2022] GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:47:49.565106 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-2794fd52-1481-489e-b3af-4806b051ba8f tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:47:49.566079 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-2794fd52-1481-489e-b3af-4806b051ba8f tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 8393c1a9-60d1-4b54-947d-3ef1a2e56845] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:49.572843 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2794fd52-1481-489e-b3af-4806b051ba8f tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:49.573326 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2794fd52-1481-489e-b3af-4806b051ba8f tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:49.574095 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2794fd52-1481-489e-b3af-4806b051ba8f tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:49.574535 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2794fd52-1481-489e-b3af-4806b051ba8f tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:49.604245 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-2794fd52-1481-489e-b3af-4806b051ba8f tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043108 May 23 15:47:49.604802 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 352/681] 10.222.0.64 () {58 vars in 1301 bytes} [Mon May 23 15:47:49 2022] GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:47:50.621660 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-fd316f0b-2972-4b5a-b2fb-686ea092b172 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:47:50.621660 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-fd316f0b-2972-4b5a-b2fb-686ea092b172 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 8393c1a9-60d1-4b54-947d-3ef1a2e56845] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:50.623938 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-fd316f0b-2972-4b5a-b2fb-686ea092b172 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:50.624386 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-fd316f0b-2972-4b5a-b2fb-686ea092b172 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:50.625298 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-fd316f0b-2972-4b5a-b2fb-686ea092b172 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:50.625606 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-fd316f0b-2972-4b5a-b2fb-686ea092b172 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:50.656660 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-fd316f0b-2972-4b5a-b2fb-686ea092b172 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043975 May 23 15:47:50.658049 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 330/682] 10.222.0.64 () {58 vars in 1301 bytes} [Mon May 23 15:47:50 2022] GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:47:50.722436 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-5d3ecc26-7731-4567-afcb-6ba2432a8bae tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:47:50.723362 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-5d3ecc26-7731-4567-afcb-6ba2432a8bae tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 53a161fc-db24-4861-8e60-b1e29465366e] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:50.730055 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5d3ecc26-7731-4567-afcb-6ba2432a8bae tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:50.730516 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5d3ecc26-7731-4567-afcb-6ba2432a8bae tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:50.731297 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5d3ecc26-7731-4567-afcb-6ba2432a8bae tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:50.731775 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5d3ecc26-7731-4567-afcb-6ba2432a8bae tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:50.761574 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-5d3ecc26-7731-4567-afcb-6ba2432a8bae tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044427 May 23 15:47:50.762139 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 353/683] 10.222.0.64 () {58 vars in 1301 bytes} [Mon May 23 15:47:50 2022] GET /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:47:50.894449 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-58286411-ff2b-43ac-9c11-9f2fc11c9348 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:47:50.894848 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-58286411-ff2b-43ac-9c11-9f2fc11c9348 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 53a161fc-db24-4861-8e60-b1e29465366e] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:50.900781 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-58286411-ff2b-43ac-9c11-9f2fc11c9348 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:50.901269 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-58286411-ff2b-43ac-9c11-9f2fc11c9348 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:50.902031 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-58286411-ff2b-43ac-9c11-9f2fc11c9348 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:50.902473 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-58286411-ff2b-43ac-9c11-9f2fc11c9348 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:50.931794 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-58286411-ff2b-43ac-9c11-9f2fc11c9348 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e/os-volume_attachments/e8b411cd-e89c-4e5c-81bc-8938979d800c" status: 200 len: 194 microversion: 2.1 time: 0.041493 May 23 15:47:50.932359 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 331/684] 10.222.0.64 () {58 vars in 1412 bytes} [Mon May 23 15:47:50 2022] GET /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e/os-volume_attachments/e8b411cd-e89c-4e5c-81bc-8938979d800c => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:47:50.942372 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-5f93d487-9e0b-43ea-9473-4ff09aac016a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:47:50.942866 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-5f93d487-9e0b-43ea-9473-4ff09aac016a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 53a161fc-db24-4861-8e60-b1e29465366e] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:50.948777 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5f93d487-9e0b-43ea-9473-4ff09aac016a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:50.949272 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5f93d487-9e0b-43ea-9473-4ff09aac016a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:50.950046 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5f93d487-9e0b-43ea-9473-4ff09aac016a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:50.950484 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5f93d487-9e0b-43ea-9473-4ff09aac016a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:51.033119 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.objects.instance [None req-5f93d487-9e0b-43ea-9473-4ff09aac016a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lazy-loading 'services' on Instance uuid 53a161fc-db24-4861-8e60-b1e29465366e {{(pid=124934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 15:47:51.314685 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-5f93d487-9e0b-43ea-9473-4ff09aac016a tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "DELETE /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e/os-volume_attachments/e8b411cd-e89c-4e5c-81bc-8938979d800c" status: 202 len: 0 microversion: 2.1 time: 0.376554 May 23 15:47:51.315322 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 354/685] 10.222.0.64 () {58 vars in 1415 bytes} [Mon May 23 15:47:50 2022] DELETE /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e/os-volume_attachments/e8b411cd-e89c-4e5c-81bc-8938979d800c => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 15:47:51.668453 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-3005146d-8219-485c-9db5-b77e52f57dd9 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:47:51.669409 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-3005146d-8219-485c-9db5-b77e52f57dd9 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 8393c1a9-60d1-4b54-947d-3ef1a2e56845] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:51.675886 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-3005146d-8219-485c-9db5-b77e52f57dd9 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:51.676335 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-3005146d-8219-485c-9db5-b77e52f57dd9 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:51.677126 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-3005146d-8219-485c-9db5-b77e52f57dd9 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:51.677565 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-3005146d-8219-485c-9db5-b77e52f57dd9 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:51.711882 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-3005146d-8219-485c-9db5-b77e52f57dd9 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047383 May 23 15:47:51.712521 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 332/686] 10.222.0.64 () {58 vars in 1301 bytes} [Mon May 23 15:47:51 2022] GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:47:52.725054 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-99f06903-2b1b-4af8-bc31-735d887f1943 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:47:52.726176 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-99f06903-2b1b-4af8-bc31-735d887f1943 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 8393c1a9-60d1-4b54-947d-3ef1a2e56845] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:52.732380 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-99f06903-2b1b-4af8-bc31-735d887f1943 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:52.732835 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-99f06903-2b1b-4af8-bc31-735d887f1943 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:52.733627 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-99f06903-2b1b-4af8-bc31-735d887f1943 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:52.734069 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-99f06903-2b1b-4af8-bc31-735d887f1943 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:52.761311 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-99f06903-2b1b-4af8-bc31-735d887f1943 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041573 May 23 15:47:52.761853 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 355/687] 10.222.0.64 () {58 vars in 1301 bytes} [Mon May 23 15:47:52 2022] GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 15:47:52.824545 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-6db7febf-1541-44bb-a851-ae96467d12ab tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:47:52.825055 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-6db7febf-1541-44bb-a851-ae96467d12ab tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 8393c1a9-60d1-4b54-947d-3ef1a2e56845] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:52.832069 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-6db7febf-1541-44bb-a851-ae96467d12ab tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:52.832578 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-6db7febf-1541-44bb-a851-ae96467d12ab tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:52.833363 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-6db7febf-1541-44bb-a851-ae96467d12ab tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:52.833798 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-6db7febf-1541-44bb-a851-ae96467d12ab tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:52.859030 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-6db7febf-1541-44bb-a851-ae96467d12ab tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 8393c1a9-60d1-4b54-947d-3ef1a2e56845] Going to try to terminate instance {{(pid=124933) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 15:47:52.862021 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:47:53.110564 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-6db7febf-1541-44bb-a851-ae96467d12ab tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "DELETE /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845" status: 204 len: 0 microversion: 2.1 time: 0.289018 May 23 15:47:53.111152 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 333/688] 10.222.0.64 () {58 vars in 1238 bytes} [Mon May 23 15:47:52 2022] DELETE /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 15:47:53.119249 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-41d04474-b3f6-49f0-b15f-a6dbb1d96b2b tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:47:53.119867 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-41d04474-b3f6-49f0-b15f-a6dbb1d96b2b tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 8393c1a9-60d1-4b54-947d-3ef1a2e56845] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:53.126460 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-41d04474-b3f6-49f0-b15f-a6dbb1d96b2b tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:53.128211 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-41d04474-b3f6-49f0-b15f-a6dbb1d96b2b tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:53.128992 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-41d04474-b3f6-49f0-b15f-a6dbb1d96b2b tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:53.129469 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-41d04474-b3f6-49f0-b15f-a6dbb1d96b2b tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:53.260889 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-41d04474-b3f6-49f0-b15f-a6dbb1d96b2b tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:47:53.269124 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-41d04474-b3f6-49f0-b15f-a6dbb1d96b2b tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845" status: 200 len: 1682 microversion: 2.1 time: 0.153678 May 23 15:47:53.269687 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 356/689] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:47:53 2022] GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:47:53.476892 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-c7f83398-8eb8-4c67-b24c-296a79f6f4ed tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:47:53.477514 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-c7f83398-8eb8-4c67-b24c-296a79f6f4ed tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 53a161fc-db24-4861-8e60-b1e29465366e] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:53.483399 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c7f83398-8eb8-4c67-b24c-296a79f6f4ed tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:53.484020 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c7f83398-8eb8-4c67-b24c-296a79f6f4ed tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:53.484787 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c7f83398-8eb8-4c67-b24c-296a79f6f4ed tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:53.485250 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c7f83398-8eb8-4c67-b24c-296a79f6f4ed tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:53.515345 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-c7f83398-8eb8-4c67-b24c-296a79f6f4ed tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e/os-volume_attachments/5646beb0-13d1-46b5-a5c6-c99b6009e412" status: 200 len: 194 microversion: 2.1 time: 0.042712 May 23 15:47:53.515932 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 334/690] 10.222.0.64 () {58 vars in 1412 bytes} [Mon May 23 15:47:53 2022] GET /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e/os-volume_attachments/5646beb0-13d1-46b5-a5c6-c99b6009e412 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:47:53.525517 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-8c894c11-16ce-4492-980b-a94d3f338ebd tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:47:53.526019 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-8c894c11-16ce-4492-980b-a94d3f338ebd tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 53a161fc-db24-4861-8e60-b1e29465366e] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:53.531896 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-8c894c11-16ce-4492-980b-a94d3f338ebd tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:53.532850 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-8c894c11-16ce-4492-980b-a94d3f338ebd tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:53.533668 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-8c894c11-16ce-4492-980b-a94d3f338ebd tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:53.534106 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-8c894c11-16ce-4492-980b-a94d3f338ebd tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:53.614056 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.objects.instance [None req-8c894c11-16ce-4492-980b-a94d3f338ebd tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lazy-loading 'services' on Instance uuid 53a161fc-db24-4861-8e60-b1e29465366e {{(pid=124934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 15:47:53.846140 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-8c894c11-16ce-4492-980b-a94d3f338ebd tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "DELETE /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e/os-volume_attachments/5646beb0-13d1-46b5-a5c6-c99b6009e412" status: 202 len: 0 microversion: 2.1 time: 0.324286 May 23 15:47:53.846802 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 357/691] 10.222.0.64 () {58 vars in 1415 bytes} [Mon May 23 15:47:53 2022] DELETE /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e/os-volume_attachments/5646beb0-13d1-46b5-a5c6-c99b6009e412 => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 15:47:54.287291 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-6067b302-661a-4a4d-87d0-1a27d278ee9b tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:47:54.287900 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-6067b302-661a-4a4d-87d0-1a27d278ee9b tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 8393c1a9-60d1-4b54-947d-3ef1a2e56845] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:54.294327 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-6067b302-661a-4a4d-87d0-1a27d278ee9b tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:54.294775 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-6067b302-661a-4a4d-87d0-1a27d278ee9b tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:54.295533 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-6067b302-661a-4a4d-87d0-1a27d278ee9b tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:54.295967 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-6067b302-661a-4a4d-87d0-1a27d278ee9b tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:54.430252 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-6067b302-661a-4a4d-87d0-1a27d278ee9b tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:47:54.437895 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-6067b302-661a-4a4d-87d0-1a27d278ee9b tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845" status: 200 len: 1682 microversion: 2.1 time: 0.155138 May 23 15:47:54.439083 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 335/692] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:47:54 2022] GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:47:55.457670 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-8a1ff5f8-c6a6-47d2-834d-9286df603fcf tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:47:55.458490 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-8a1ff5f8-c6a6-47d2-834d-9286df603fcf tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 8393c1a9-60d1-4b54-947d-3ef1a2e56845] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:55.465711 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-8a1ff5f8-c6a6-47d2-834d-9286df603fcf tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:55.466706 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-8a1ff5f8-c6a6-47d2-834d-9286df603fcf tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:55.468138 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-8a1ff5f8-c6a6-47d2-834d-9286df603fcf tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:55.468898 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-8a1ff5f8-c6a6-47d2-834d-9286df603fcf tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:55.932234 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-8a1ff5f8-c6a6-47d2-834d-9286df603fcf tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:47:55.939820 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-8a1ff5f8-c6a6-47d2-834d-9286df603fcf tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845" status: 200 len: 1682 microversion: 2.1 time: 0.487725 May 23 15:47:55.940590 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 358/693] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:47:55 2022] GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845 => generated 1682 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:47:56.058660 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-8ed00a4d-891c-4375-9d84-8c3925a0fdaa tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:47:56.059966 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-8ed00a4d-891c-4375-9d84-8c3925a0fdaa tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 53a161fc-db24-4861-8e60-b1e29465366e] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:56.066906 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-8ed00a4d-891c-4375-9d84-8c3925a0fdaa tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:56.067432 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-8ed00a4d-891c-4375-9d84-8c3925a0fdaa tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:56.068318 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-8ed00a4d-891c-4375-9d84-8c3925a0fdaa tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:56.068757 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-8ed00a4d-891c-4375-9d84-8c3925a0fdaa tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:56.099671 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-8ed00a4d-891c-4375-9d84-8c3925a0fdaa tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044988 May 23 15:47:56.100235 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 336/694] 10.222.0.64 () {58 vars in 1301 bytes} [Mon May 23 15:47:56 2022] GET /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 15:47:56.207485 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-9e9970fc-6e47-4cdc-ac04-a5e904badc74 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:47:56.212964 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-9e9970fc-6e47-4cdc-ac04-a5e904badc74 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 53a161fc-db24-4861-8e60-b1e29465366e] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:56.214741 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-9e9970fc-6e47-4cdc-ac04-a5e904badc74 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:56.215201 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-9e9970fc-6e47-4cdc-ac04-a5e904badc74 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:56.215979 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-9e9970fc-6e47-4cdc-ac04-a5e904badc74 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:56.216423 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-9e9970fc-6e47-4cdc-ac04-a5e904badc74 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:56.245208 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-9e9970fc-6e47-4cdc-ac04-a5e904badc74 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041797 May 23 15:47:56.245764 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 359/695] 10.222.0.64 () {58 vars in 1301 bytes} [Mon May 23 15:47:56 2022] GET /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 15:47:56.304822 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-69ba2a7b-eee9-4d0a-91d1-ccebbf2ea6dd tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:47:56.305354 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-69ba2a7b-eee9-4d0a-91d1-ccebbf2ea6dd tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 53a161fc-db24-4861-8e60-b1e29465366e] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:56.311273 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-69ba2a7b-eee9-4d0a-91d1-ccebbf2ea6dd tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:56.311724 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-69ba2a7b-eee9-4d0a-91d1-ccebbf2ea6dd tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:56.312493 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-69ba2a7b-eee9-4d0a-91d1-ccebbf2ea6dd tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:56.312948 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-69ba2a7b-eee9-4d0a-91d1-ccebbf2ea6dd tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:56.338940 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-69ba2a7b-eee9-4d0a-91d1-ccebbf2ea6dd tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 53a161fc-db24-4861-8e60-b1e29465366e] Going to try to terminate instance {{(pid=124933) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 15:47:56.614957 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [req-a639fd4f-7ee7-4855-8c16-ec87362ed2ce req-a267a013-3793-4224-a046-772c163f0fce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8393c1a9-60d1-4b54-947d-3ef1a2e56845", "name": "network-vif-deleted", "tag": "ab319228-d2e4-408a-a8f8-6e3febb2286b"}]} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:47:56.624294 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-a639fd4f-7ee7-4855-8c16-ec87362ed2ce req-a267a013-3793-4224-a046-772c163f0fce service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:56.629700 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-a639fd4f-7ee7-4855-8c16-ec87362ed2ce req-a267a013-3793-4224-a046-772c163f0fce service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:56.636471 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.compute.server_external_events [req-a639fd4f-7ee7-4855-8c16-ec87362ed2ce req-a267a013-3793-4224-a046-772c163f0fce service nova] Creating event network-vif-deleted:ab319228-d2e4-408a-a8f8-6e3febb2286b for instance 8393c1a9-60d1-4b54-947d-3ef1a2e56845 on hv-cinder-84067 May 23 15:47:56.641315 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [req-a639fd4f-7ee7-4855-8c16-ec87362ed2ce req-a267a013-3793-4224-a046-772c163f0fce service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030474 May 23 15:47:56.641908 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 360/696] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:47:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:47:56.675964 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-69ba2a7b-eee9-4d0a-91d1-ccebbf2ea6dd tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "DELETE /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e" status: 204 len: 0 microversion: 2.1 time: 0.374703 May 23 15:47:56.683183 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 337/697] 10.222.0.64 () {58 vars in 1238 bytes} [Mon May 23 15:47:56 2022] DELETE /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 15:47:56.689411 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-e7d54e33-9214-4572-9b98-a6243dc0cfba tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:47:56.691111 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-e7d54e33-9214-4572-9b98-a6243dc0cfba tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 53a161fc-db24-4861-8e60-b1e29465366e] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:56.708824 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e7d54e33-9214-4572-9b98-a6243dc0cfba tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:56.710083 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e7d54e33-9214-4572-9b98-a6243dc0cfba tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:56.710225 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e7d54e33-9214-4572-9b98-a6243dc0cfba tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:56.710610 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e7d54e33-9214-4572-9b98-a6243dc0cfba tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:56.855841 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-e7d54e33-9214-4572-9b98-a6243dc0cfba tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:47:56.864039 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-e7d54e33-9214-4572-9b98-a6243dc0cfba tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e" status: 200 len: 1674 microversion: 2.1 time: 0.182848 May 23 15:47:56.864704 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 361/698] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:47:56 2022] GET /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e => generated 1674 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:47:56.959004 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-d7a0f2ca-833c-4c5b-a165-776ddb288633 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:47:56.959739 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-d7a0f2ca-833c-4c5b-a165-776ddb288633 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 8393c1a9-60d1-4b54-947d-3ef1a2e56845] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:56.966576 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-d7a0f2ca-833c-4c5b-a165-776ddb288633 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:56.967087 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-d7a0f2ca-833c-4c5b-a165-776ddb288633 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:56.967862 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-d7a0f2ca-833c-4c5b-a165-776ddb288633 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:56.968299 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-d7a0f2ca-833c-4c5b-a165-776ddb288633 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:57.031707 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-d7a0f2ca-833c-4c5b-a165-776ddb288633 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:47:57.039894 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-d7a0f2ca-833c-4c5b-a165-776ddb288633 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845" status: 200 len: 1326 microversion: 2.1 time: 0.086201 May 23 15:47:57.040473 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 338/699] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:47:56 2022] GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845 => generated 1326 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:47:57.881265 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-4575b67f-d10d-4e0c-9259-1fb617a8fc85 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:47:57.881793 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-4575b67f-d10d-4e0c-9259-1fb617a8fc85 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 53a161fc-db24-4861-8e60-b1e29465366e] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:57.888266 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4575b67f-d10d-4e0c-9259-1fb617a8fc85 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:57.888711 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4575b67f-d10d-4e0c-9259-1fb617a8fc85 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:57.889503 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4575b67f-d10d-4e0c-9259-1fb617a8fc85 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:57.889940 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4575b67f-d10d-4e0c-9259-1fb617a8fc85 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:57.902557 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-80d3f1fd-2235-47c1-97c6-845fb6d7e11b tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:47:57.903044 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-80d3f1fd-2235-47c1-97c6-845fb6d7e11b tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: 54ec3019-6a8e-4080-a386-3894a165c7eb] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:57.910358 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-80d3f1fd-2235-47c1-97c6-845fb6d7e11b tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:57.910809 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-80d3f1fd-2235-47c1-97c6-845fb6d7e11b tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:57.911582 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-80d3f1fd-2235-47c1-97c6-845fb6d7e11b tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:57.912024 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-80d3f1fd-2235-47c1-97c6-845fb6d7e11b tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:57.937830 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-80d3f1fd-2235-47c1-97c6-845fb6d7e11b tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: 54ec3019-6a8e-4080-a386-3894a165c7eb] Going to try to terminate instance {{(pid=124933) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 15:47:58.017350 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-4575b67f-d10d-4e0c-9259-1fb617a8fc85 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:47:58.025368 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-4575b67f-d10d-4e0c-9259-1fb617a8fc85 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e" status: 200 len: 1674 microversion: 2.1 time: 0.148041 May 23 15:47:58.025935 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 362/700] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:47:57 2022] GET /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e => generated 1674 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:47:58.055885 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-e02b70e7-c305-4ee7-87cb-3c863b5d6dc9 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:47:58.056501 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-e02b70e7-c305-4ee7-87cb-3c863b5d6dc9 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 8393c1a9-60d1-4b54-947d-3ef1a2e56845] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:58.062348 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e02b70e7-c305-4ee7-87cb-3c863b5d6dc9 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:58.062801 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e02b70e7-c305-4ee7-87cb-3c863b5d6dc9 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:58.063597 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e02b70e7-c305-4ee7-87cb-3c863b5d6dc9 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:58.064042 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e02b70e7-c305-4ee7-87cb-3c863b5d6dc9 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:58.124492 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-e02b70e7-c305-4ee7-87cb-3c863b5d6dc9 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:47:58.132573 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-e02b70e7-c305-4ee7-87cb-3c863b5d6dc9 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845" status: 200 len: 1326 microversion: 2.1 time: 0.080208 May 23 15:47:58.133077 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 363/701] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:47:58 2022] GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845 => generated 1326 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:47:58.246598 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-80d3f1fd-2235-47c1-97c6-845fb6d7e11b tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "DELETE /compute/v2.1/servers/54ec3019-6a8e-4080-a386-3894a165c7eb" status: 204 len: 0 microversion: 2.1 time: 0.347550 May 23 15:47:58.247182 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 339/702] 10.222.0.64 () {58 vars in 1238 bytes} [Mon May 23 15:47:57 2022] DELETE /compute/v2.1/servers/54ec3019-6a8e-4080-a386-3894a165c7eb => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 23 15:47:58.255676 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-2d6e668f-fe32-4824-85ec-37f65dccf685 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:47:58.256966 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-2d6e668f-fe32-4824-85ec-37f65dccf685 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: 54ec3019-6a8e-4080-a386-3894a165c7eb] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:58.262313 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2d6e668f-fe32-4824-85ec-37f65dccf685 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:58.262775 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2d6e668f-fe32-4824-85ec-37f65dccf685 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:58.263529 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2d6e668f-fe32-4824-85ec-37f65dccf685 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:58.263969 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2d6e668f-fe32-4824-85ec-37f65dccf685 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:58.396137 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-2d6e668f-fe32-4824-85ec-37f65dccf685 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:47:58.403733 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-2d6e668f-fe32-4824-85ec-37f65dccf685 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/54ec3019-6a8e-4080-a386-3894a165c7eb" status: 200 len: 1579 microversion: 2.1 time: 0.152375 May 23 15:47:58.404359 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 364/703] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:47:58 2022] GET /compute/v2.1/servers/54ec3019-6a8e-4080-a386-3894a165c7eb => generated 1579 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:47:59.043119 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-0adc4ff4-eba0-4bfd-985d-b73647ae242b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:47:59.043825 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-0adc4ff4-eba0-4bfd-985d-b73647ae242b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 53a161fc-db24-4861-8e60-b1e29465366e] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:59.051524 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-0adc4ff4-eba0-4bfd-985d-b73647ae242b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:59.051980 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-0adc4ff4-eba0-4bfd-985d-b73647ae242b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:59.052741 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-0adc4ff4-eba0-4bfd-985d-b73647ae242b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:59.053212 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-0adc4ff4-eba0-4bfd-985d-b73647ae242b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:59.149797 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-9e3a6e14-3288-4797-9ab4-459bd3761a71 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:47:59.150415 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-9e3a6e14-3288-4797-9ab4-459bd3761a71 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 8393c1a9-60d1-4b54-947d-3ef1a2e56845] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:59.157094 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-9e3a6e14-3288-4797-9ab4-459bd3761a71 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:59.157545 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-9e3a6e14-3288-4797-9ab4-459bd3761a71 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:59.158396 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-9e3a6e14-3288-4797-9ab4-459bd3761a71 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:59.159049 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-9e3a6e14-3288-4797-9ab4-459bd3761a71 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:59.181130 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-0adc4ff4-eba0-4bfd-985d-b73647ae242b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:47:59.188588 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-0adc4ff4-eba0-4bfd-985d-b73647ae242b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e" status: 200 len: 1674 microversion: 2.1 time: 0.149641 May 23 15:47:59.189908 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 340/704] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:47:59 2022] GET /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:47:59.191374 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-9e3a6e14-3288-4797-9ab4-459bd3761a71 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:59.191830 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-9e3a6e14-3288-4797-9ab4-459bd3761a71 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:59.192288 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.objects.instance [None req-9e3a6e14-3288-4797-9ab4-459bd3761a71 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lazy-loading 'fault' on Instance uuid 8393c1a9-60d1-4b54-947d-3ef1a2e56845 {{(pid=124934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 15:47:59.195112 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:47:59.235705 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-9e3a6e14-3288-4797-9ab4-459bd3761a71 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:47:59.243428 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-9e3a6e14-3288-4797-9ab4-459bd3761a71 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845" status: 200 len: 1331 microversion: 2.1 time: 0.097519 May 23 15:47:59.243991 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 365/705] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:47:59 2022] GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845 => generated 1331 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:47:59.421901 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-cc0509f5-10b3-4200-b037-65ba756e62eb tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:47:59.422447 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-cc0509f5-10b3-4200-b037-65ba756e62eb tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: 54ec3019-6a8e-4080-a386-3894a165c7eb] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:47:59.428769 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-cc0509f5-10b3-4200-b037-65ba756e62eb tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:59.429288 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-cc0509f5-10b3-4200-b037-65ba756e62eb tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:59.430059 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-cc0509f5-10b3-4200-b037-65ba756e62eb tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:47:59.430503 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-cc0509f5-10b3-4200-b037-65ba756e62eb tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:47:59.558682 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-cc0509f5-10b3-4200-b037-65ba756e62eb tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:47:59.566322 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-cc0509f5-10b3-4200-b037-65ba756e62eb tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/54ec3019-6a8e-4080-a386-3894a165c7eb" status: 200 len: 1579 microversion: 2.1 time: 0.148307 May 23 15:47:59.566888 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 341/706] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:47:59 2022] GET /compute/v2.1/servers/54ec3019-6a8e-4080-a386-3894a165c7eb => generated 1579 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:48:00.206530 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-f15d84b7-f32f-49dd-8f48-db0cca51953e tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:00.207147 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-f15d84b7-f32f-49dd-8f48-db0cca51953e tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 53a161fc-db24-4861-8e60-b1e29465366e] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:00.213719 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-f15d84b7-f32f-49dd-8f48-db0cca51953e tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:00.214165 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-f15d84b7-f32f-49dd-8f48-db0cca51953e tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:00.214924 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-f15d84b7-f32f-49dd-8f48-db0cca51953e tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:00.215356 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-f15d84b7-f32f-49dd-8f48-db0cca51953e tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:00.260648 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-42ba866d-ca27-4962-ac22-bd483e9b58b3 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:00.261478 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-42ba866d-ca27-4962-ac22-bd483e9b58b3 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 8393c1a9-60d1-4b54-947d-3ef1a2e56845] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:00.268119 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-42ba866d-ca27-4962-ac22-bd483e9b58b3 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:00.268572 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-42ba866d-ca27-4962-ac22-bd483e9b58b3 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:00.269376 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-42ba866d-ca27-4962-ac22-bd483e9b58b3 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:00.269817 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-42ba866d-ca27-4962-ac22-bd483e9b58b3 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:00.301713 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-42ba866d-ca27-4962-ac22-bd483e9b58b3 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:00.302169 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-42ba866d-ca27-4962-ac22-bd483e9b58b3 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:00.302620 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.objects.instance [None req-42ba866d-ca27-4962-ac22-bd483e9b58b3 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lazy-loading 'fault' on Instance uuid 8393c1a9-60d1-4b54-947d-3ef1a2e56845 {{(pid=124933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 15:48:00.357743 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-42ba866d-ca27-4962-ac22-bd483e9b58b3 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:00.365625 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-42ba866d-ca27-4962-ac22-bd483e9b58b3 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845" status: 200 len: 1331 microversion: 2.1 time: 0.108907 May 23 15:48:00.366214 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 342/707] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:48:00 2022] GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845 => generated 1331 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:48:00.374781 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-f15d84b7-f32f-49dd-8f48-db0cca51953e tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:00.382819 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-f15d84b7-f32f-49dd-8f48-db0cca51953e tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e" status: 200 len: 1674 microversion: 2.1 time: 0.180510 May 23 15:48:00.383373 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 366/708] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:48:00 2022] GET /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e => generated 1674 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:48:00.584176 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-03cea9ff-9568-4dd5-b10e-b693f3f64479 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:00.584794 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-03cea9ff-9568-4dd5-b10e-b693f3f64479 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: 54ec3019-6a8e-4080-a386-3894a165c7eb] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:00.590872 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-03cea9ff-9568-4dd5-b10e-b693f3f64479 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:00.591327 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-03cea9ff-9568-4dd5-b10e-b693f3f64479 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:00.592103 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-03cea9ff-9568-4dd5-b10e-b693f3f64479 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:00.592544 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-03cea9ff-9568-4dd5-b10e-b693f3f64479 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:00.758510 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-03cea9ff-9568-4dd5-b10e-b693f3f64479 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:00.768645 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-03cea9ff-9568-4dd5-b10e-b693f3f64479 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/54ec3019-6a8e-4080-a386-3894a165c7eb" status: 200 len: 1579 microversion: 2.1 time: 0.188042 May 23 15:48:00.769246 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 343/709] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:48:00 2022] GET /compute/v2.1/servers/54ec3019-6a8e-4080-a386-3894a165c7eb => generated 1579 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:48:01.382452 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-85d4dcd1-59da-4771-88e7-d0b8261143b3 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:01.383048 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-85d4dcd1-59da-4771-88e7-d0b8261143b3 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 8393c1a9-60d1-4b54-947d-3ef1a2e56845] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:01.389735 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-85d4dcd1-59da-4771-88e7-d0b8261143b3 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:01.390187 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-85d4dcd1-59da-4771-88e7-d0b8261143b3 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:01.390951 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-85d4dcd1-59da-4771-88e7-d0b8261143b3 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:01.391385 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-85d4dcd1-59da-4771-88e7-d0b8261143b3 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:01.401775 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-fb6e430d-274e-4bdb-9e03-5602077cf275 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:01.402545 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-fb6e430d-274e-4bdb-9e03-5602077cf275 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 53a161fc-db24-4861-8e60-b1e29465366e] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:01.405714 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.wsgi [None req-85d4dcd1-59da-4771-88e7-d0b8261143b3 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] HTTP exception thrown: Instance 8393c1a9-60d1-4b54-947d-3ef1a2e56845 could not be found. May 23 15:48:01.407417 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-85d4dcd1-59da-4771-88e7-d0b8261143b3 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Request method failure captured: May 23 15:48:01.407417 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: request: GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845 HTTP/1.1 May 23 15:48:01.407417 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Accept: application/json May 23 15:48:01.407417 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Accept-Encoding: identity May 23 15:48:01.407417 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Connection: close May 23 15:48:01.407417 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Content-Length: 0 May 23 15:48:01.407417 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Content-Type: application/json May 23 15:48:01.407417 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Host: 10.222.0.64 May 23 15:48:01.407417 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Openstack-System-Scope: None May 23 15:48:01.407417 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: User-Agent: python-urllib3/1.26.9 May 23 15:48:01.407417 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Auth-Token: gAAAAABii6uOGntB7Pc55mvjpSIsPzNLOlywCYGbr_-Vzy5_quOX_mjNj5PwEdU1U5x_QaGgk51iZzj3S4TZVzOIWCHWkRILSGjcG5ZDd1N2DadGTyYCWvrZ0p61UD6zAV5lw6yOUFVzzVm3KSoYQSF_ZlPFocwbQbQqnGoN6Tr34TmSqfoSNW8 May 23 15:48:01.407417 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Domain-Id: None May 23 15:48:01.407417 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Domain-Name: None May 23 15:48:01.407417 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Identity-Status: Confirmed May 23 15:48:01.407417 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Is-Admin-Project: True May 23 15:48:01.407417 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Domain-Id: default May 23 15:48:01.407417 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Domain-Name: Default May 23 15:48:01.407417 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Id: a15ae9d15a64468f80628ed51c2e42d6 May 23 15:48:01.407417 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Name: tempest-AttachVolumeNegativeTest-2009285566 May 23 15:48:01.407417 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Role: reader,member May 23 15:48:01.407417 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Roles: reader,member May 23 15:48:01.409455 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a15ae9d15a64468f80628ed51c2e42d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a15ae9d15a64468f80628ed51c2e42d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a15ae9d15a64468f80628ed51c2e42d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a15ae9d15a64468f80628ed51c2e42d6", "adminURL": "http://10.222.0.64:8080"}]}] May 23 15:48:01.409455 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant: tempest-AttachVolumeNegativeTest-2009285566 May 23 15:48:01.409455 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant-Id: a15ae9d15a64468f80628ed51c2e42d6 May 23 15:48:01.409455 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2009285566 May 23 15:48:01.409455 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User: tempest-AttachVolumeNegativeTest-2009285566-project May 23 15:48:01.409455 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Domain-Id: default May 23 15:48:01.409455 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Domain-Name: Default May 23 15:48:01.409455 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Id: 472049224bbf48699b8a9410ec61aa9e May 23 15:48:01.409455 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Name: tempest-AttachVolumeNegativeTest-2009285566-project May 23 15:48:01.409455 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: method: > May 23 15:48:01.409455 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: exception: Instance 8393c1a9-60d1-4b54-947d-3ef1a2e56845 could not be found. May 23 15:48:01.409455 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: action_args: {'id': '8393c1a9-60d1-4b54-947d-3ef1a2e56845'} May 23 15:48:01.410285 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:48:01.410285 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:48:01.410285 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:48:01.410285 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:48:01.410285 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:48:01.410285 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:48:01.410285 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:48:01.410285 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:48:01.410285 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:48:01.410285 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:48:01.410285 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8393c1a9-60d1-4b54-947d-3ef1a2e56845 could not be found. May 23 15:48:01.410285 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:48:01.410285 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:48:01.410285 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:48:01.410285 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:48:01.410285 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:48:01.410285 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:48:01.410285 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:48:01.410285 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:48:01.410285 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:48:01.411791 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:48:01.411791 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 15:48:01.411791 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 15:48:01.411791 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:48:01.411791 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:48:01.411791 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:48:01.411791 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:48:01.411791 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8393c1a9-60d1-4b54-947d-3ef1a2e56845 could not be found. May 23 15:48:01.411791 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:48:01.411791 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:48:01.411791 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:48:01.411791 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:48:01.411791 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:48:01.411791 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:48:01.411791 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:48:01.411791 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:48:01.411791 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8393c1a9-60d1-4b54-947d-3ef1a2e56845 could not be found. May 23 15:48:01.411791 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:48:01.413134 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-85d4dcd1-59da-4771-88e7-d0b8261143b3 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Returning 404 to user: Instance 8393c1a9-60d1-4b54-947d-3ef1a2e56845 could not be found. {{(pid=124934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:48:01.413134 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-85d4dcd1-59da-4771-88e7-d0b8261143b3 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845" status: 404 len: 111 microversion: 2.1 time: 0.030356 May 23 15:48:01.413134 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 367/710] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:48:01 2022] GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 15:48:01.415227 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-fb6e430d-274e-4bdb-9e03-5602077cf275 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:01.415679 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-fb6e430d-274e-4bdb-9e03-5602077cf275 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:01.416452 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-fb6e430d-274e-4bdb-9e03-5602077cf275 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:01.416887 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-fb6e430d-274e-4bdb-9e03-5602077cf275 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:01.417886 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-59ad9310-8eed-4fbc-9986-94f0426c99e0 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '.version_select at 0x7fab51e5daf0>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:01.510567 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-59ad9310-8eed-4fbc-9986-94f0426c99e0 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1447800045" status: 202 len: 0 microversion: 2.1 time: 0.096131 May 23 15:48:01.511095 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 368/711] 10.222.0.64 () {58 vars in 1220 bytes} [Mon May 23 15:48:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1447800045 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 23 15:48:01.697938 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-fb6e430d-274e-4bdb-9e03-5602077cf275 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:01.706231 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-fb6e430d-274e-4bdb-9e03-5602077cf275 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e" status: 200 len: 1674 microversion: 2.1 time: 0.308612 May 23 15:48:01.712501 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 344/712] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:48:01 2022] GET /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e => generated 1674 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:48:01.787463 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-6ccbd73d-2553-4b95-9121-816551265e70 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:01.788189 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-6ccbd73d-2553-4b95-9121-816551265e70 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: 54ec3019-6a8e-4080-a386-3894a165c7eb] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:01.796765 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-6ccbd73d-2553-4b95-9121-816551265e70 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:01.797348 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-6ccbd73d-2553-4b95-9121-816551265e70 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:01.798206 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-6ccbd73d-2553-4b95-9121-816551265e70 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:01.799643 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-6ccbd73d-2553-4b95-9121-816551265e70 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:02.009854 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-6ccbd73d-2553-4b95-9121-816551265e70 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:02.017894 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-6ccbd73d-2553-4b95-9121-816551265e70 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/54ec3019-6a8e-4080-a386-3894a165c7eb" status: 200 len: 1579 microversion: 2.1 time: 0.235701 May 23 15:48:02.018776 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 369/713] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:48:01 2022] GET /compute/v2.1/servers/54ec3019-6a8e-4080-a386-3894a165c7eb => generated 1579 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:48:02.361244 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-3ac5ee6c-b2c1-4320-a887-b94b082dc1b7 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Action: 'create', calling method: .version_select at 0x7fab520030d0>, body: {"keypair": {"name": "tempest-keypair-2020239585", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGLnz3fpXq2ERGlonM59PhSQ2FTZgFMiXZ+cYWR8hVPetdFBUwQGhnQEnlUIEqxPHEc46TXdDkbkeBma4HRf8wMm2jy1Wv2Yd5SyHQvf8xm8vOJDl2zvsl/Tz5cXdMfuDg=="}} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:48:02.377951 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.quota [None req-3ac5ee6c-b2c1-4320-a887-b94b082dc1b7 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Getting quotas for project a15ae9d15a64468f80628ed51c2e42d6. Resources: {'key_pairs'} {{(pid=124933) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 15:48:02.383659 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.quota [None req-3ac5ee6c-b2c1-4320-a887-b94b082dc1b7 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Getting quotas for user 472049224bbf48699b8a9410ec61aa9e and project a15ae9d15a64468f80628ed51c2e42d6. Resources: {'key_pairs'} {{(pid=124933) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 15:48:02.482769 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-3ac5ee6c-b2c1-4320-a887-b94b082dc1b7 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.125668 May 23 15:48:02.483411 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 345/714] 10.222.0.64 () {60 vars in 1158 bytes} [Mon May 23 15:48:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:48:02.575579 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [req-0bc0eb3a-dfc3-438c-ac2a-ebf119cfdc6a req-b4d9291a-39fd-45f2-a439-9434adcf51c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54ec3019-6a8e-4080-a386-3894a165c7eb", "name": "network-vif-deleted", "tag": "9998b808-7746-404c-a44c-c2b50e15e918"}, {"server_uuid": "53a161fc-db24-4861-8e60-b1e29465366e", "name": "network-vif-deleted", "tag": "75239bc1-69c6-438c-af43-de4ccb9f0f6d"}]} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:48:02.589124 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-0bc0eb3a-dfc3-438c-ac2a-ebf119cfdc6a req-b4d9291a-39fd-45f2-a439-9434adcf51c0 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:02.589499 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-0bc0eb3a-dfc3-438c-ac2a-ebf119cfdc6a req-b4d9291a-39fd-45f2-a439-9434adcf51c0 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:02.606571 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.compute.server_external_events [req-0bc0eb3a-dfc3-438c-ac2a-ebf119cfdc6a req-b4d9291a-39fd-45f2-a439-9434adcf51c0 service nova] Creating event network-vif-deleted:9998b808-7746-404c-a44c-c2b50e15e918 for instance 54ec3019-6a8e-4080-a386-3894a165c7eb on hv-cinder-84067 May 23 15:48:02.607358 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.compute.server_external_events [req-0bc0eb3a-dfc3-438c-ac2a-ebf119cfdc6a req-b4d9291a-39fd-45f2-a439-9434adcf51c0 service nova] Creating event network-vif-deleted:75239bc1-69c6-438c-af43-de4ccb9f0f6d for instance 53a161fc-db24-4861-8e60-b1e29465366e on hv-cinder-84067 May 23 15:48:02.618902 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [req-0bc0eb3a-dfc3-438c-ac2a-ebf119cfdc6a req-b4d9291a-39fd-45f2-a439-9434adcf51c0 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.046056 May 23 15:48:02.625296 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 370/715] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:48:02 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:48:02.724422 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-dfb819f9-d72c-4ef4-bed7-dca532c157d9 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:02.724944 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-dfb819f9-d72c-4ef4-bed7-dca532c157d9 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 53a161fc-db24-4861-8e60-b1e29465366e] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:02.731430 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-dfb819f9-d72c-4ef4-bed7-dca532c157d9 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:02.731885 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-dfb819f9-d72c-4ef4-bed7-dca532c157d9 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:02.733394 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-dfb819f9-d72c-4ef4-bed7-dca532c157d9 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:02.733840 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-dfb819f9-d72c-4ef4-bed7-dca532c157d9 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:02.744728 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:48:02.882984 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-dfb819f9-d72c-4ef4-bed7-dca532c157d9 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:02.894999 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-dfb819f9-d72c-4ef4-bed7-dca532c157d9 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e" status: 200 len: 1606 microversion: 2.1 time: 0.174891 May 23 15:48:02.897111 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 346/716] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:48:02 2022] GET /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e => generated 1606 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:48:03.036263 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-9f122db2-bb0b-4aef-9fd9-fdf4df7fb922 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:03.036983 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-9f122db2-bb0b-4aef-9fd9-fdf4df7fb922 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: 54ec3019-6a8e-4080-a386-3894a165c7eb] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:03.047175 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-9f122db2-bb0b-4aef-9fd9-fdf4df7fb922 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:03.051907 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-9f122db2-bb0b-4aef-9fd9-fdf4df7fb922 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:03.051907 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-9f122db2-bb0b-4aef-9fd9-fdf4df7fb922 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:03.051907 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-9f122db2-bb0b-4aef-9fd9-fdf4df7fb922 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:03.143537 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-9f122db2-bb0b-4aef-9fd9-fdf4df7fb922 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:03.151324 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-9f122db2-bb0b-4aef-9fd9-fdf4df7fb922 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/54ec3019-6a8e-4080-a386-3894a165c7eb" status: 200 len: 1226 microversion: 2.1 time: 0.119926 May 23 15:48:03.151898 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 371/717] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:48:03 2022] GET /compute/v2.1/servers/54ec3019-6a8e-4080-a386-3894a165c7eb => generated 1226 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:48:03.914168 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-bd1b0e86-6028-4925-91cb-dbb97b42b2de tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:03.914814 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-bd1b0e86-6028-4925-91cb-dbb97b42b2de tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 53a161fc-db24-4861-8e60-b1e29465366e] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:03.925403 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-bd1b0e86-6028-4925-91cb-dbb97b42b2de tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:03.925861 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-bd1b0e86-6028-4925-91cb-dbb97b42b2de tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:03.926650 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-bd1b0e86-6028-4925-91cb-dbb97b42b2de tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:03.927146 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-bd1b0e86-6028-4925-91cb-dbb97b42b2de tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:03.960802 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-bd1b0e86-6028-4925-91cb-dbb97b42b2de tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:03.961295 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-bd1b0e86-6028-4925-91cb-dbb97b42b2de tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:03.962072 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.objects.instance [None req-bd1b0e86-6028-4925-91cb-dbb97b42b2de tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lazy-loading 'fault' on Instance uuid 53a161fc-db24-4861-8e60-b1e29465366e {{(pid=124933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 15:48:04.005747 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-bd1b0e86-6028-4925-91cb-dbb97b42b2de tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5236a93fc3a84d27bf3d150e85eb2589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7ac236cd4d414fb70eb8da6da53484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:04.014671 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-bd1b0e86-6028-4925-91cb-dbb97b42b2de tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e" status: 200 len: 1328 microversion: 2.1 time: 0.105108 May 23 15:48:04.014671 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 347/718] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:48:03 2022] GET /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e => generated 1328 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:48:04.167713 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-8473a30f-3826-4eca-8fc4-53f60cada099 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:04.168347 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-8473a30f-3826-4eca-8fc4-53f60cada099 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: 54ec3019-6a8e-4080-a386-3894a165c7eb] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:04.174842 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-8473a30f-3826-4eca-8fc4-53f60cada099 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:04.175284 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-8473a30f-3826-4eca-8fc4-53f60cada099 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:04.176043 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-8473a30f-3826-4eca-8fc4-53f60cada099 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:04.176658 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-8473a30f-3826-4eca-8fc4-53f60cada099 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:04.207173 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-8473a30f-3826-4eca-8fc4-53f60cada099 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:04.207621 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-8473a30f-3826-4eca-8fc4-53f60cada099 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:04.208072 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.objects.instance [None req-8473a30f-3826-4eca-8fc4-53f60cada099 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lazy-loading 'fault' on Instance uuid 54ec3019-6a8e-4080-a386-3894a165c7eb {{(pid=124934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 15:48:04.248874 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-8473a30f-3826-4eca-8fc4-53f60cada099 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:04.257314 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-8473a30f-3826-4eca-8fc4-53f60cada099 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/54ec3019-6a8e-4080-a386-3894a165c7eb" status: 200 len: 1231 microversion: 2.1 time: 0.093386 May 23 15:48:04.258172 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 372/719] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:48:04 2022] GET /compute/v2.1/servers/54ec3019-6a8e-4080-a386-3894a165c7eb => generated 1231 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:48:04.974033 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-b8dc9d27-73e1-474c-81c2-2cb17ad1d144 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-583330182", "imageRef": "a5c8503f-3733-426f-8a5b-c7c9358e4a45", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6b67b25e-d689-4151-bafc-c9d67faaca84"}], "security_groups": [{"name": "tempest-securitygroup--709310517"}], "key_name": "tempest-keypair-2020239585", "user_data": "}} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:48:05.031260 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-809f7cb3-79a0-4b2b-ad7e-7d89549001ef tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:05.031965 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-809f7cb3-79a0-4b2b-ad7e-7d89549001ef tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 53a161fc-db24-4861-8e60-b1e29465366e] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:05.038778 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-809f7cb3-79a0-4b2b-ad7e-7d89549001ef tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:05.039253 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-809f7cb3-79a0-4b2b-ad7e-7d89549001ef tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:05.040029 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-809f7cb3-79a0-4b2b-ad7e-7d89549001ef tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:05.040467 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-809f7cb3-79a0-4b2b-ad7e-7d89549001ef tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:05.054985 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.wsgi [None req-809f7cb3-79a0-4b2b-ad7e-7d89549001ef tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] HTTP exception thrown: Instance 53a161fc-db24-4861-8e60-b1e29465366e could not be found. May 23 15:48:05.056637 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-809f7cb3-79a0-4b2b-ad7e-7d89549001ef tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Request method failure captured: May 23 15:48:05.056637 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: request: GET /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e HTTP/1.1 May 23 15:48:05.056637 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Accept: application/json May 23 15:48:05.056637 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Accept-Encoding: identity May 23 15:48:05.056637 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Connection: close May 23 15:48:05.056637 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Content-Length: 0 May 23 15:48:05.056637 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Content-Type: application/json May 23 15:48:05.056637 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Host: 10.222.0.64 May 23 15:48:05.056637 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Openstack-System-Scope: None May 23 15:48:05.056637 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: User-Agent: python-urllib3/1.26.9 May 23 15:48:05.056637 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Auth-Token: gAAAAABii6s5te8GOjKrfAiv0Xf4k5hpEIekrfbYkgWsUlONJEd5IzBjOwa-F0NrdS9U2FReEjSKki20nknUbrI8hjkEKlGxJYFyk8iHUDzAljl1LnKqWL1Ulq6dP7R2suSMvGgQbwdVVqnorKIgEad5uHXYWrgLbilvMKjMAuNuN-pGwRi0zuM May 23 15:48:05.056637 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Domain-Id: None May 23 15:48:05.056637 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Domain-Name: None May 23 15:48:05.056637 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Identity-Status: Confirmed May 23 15:48:05.056637 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Is-Admin-Project: True May 23 15:48:05.056637 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Domain-Id: default May 23 15:48:05.056637 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Domain-Name: Default May 23 15:48:05.056637 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Id: 8d7ac236cd4d414fb70eb8da6da53484 May 23 15:48:05.056637 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Name: tempest-AttachVolumeTestJSON-945416102 May 23 15:48:05.056637 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Role: reader,member May 23 15:48:05.056637 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Roles: reader,member May 23 15:48:05.058319 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/8d7ac236cd4d414fb70eb8da6da53484"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/8d7ac236cd4d414fb70eb8da6da53484"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/8d7ac236cd4d414fb70eb8da6da53484"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_8d7ac236cd4d414fb70eb8da6da53484", "adminURL": "http://10.222.0.64:8080"}]}] May 23 15:48:05.058319 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant: tempest-AttachVolumeTestJSON-945416102 May 23 15:48:05.058319 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant-Id: 8d7ac236cd4d414fb70eb8da6da53484 May 23 15:48:05.058319 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant-Name: tempest-AttachVolumeTestJSON-945416102 May 23 15:48:05.058319 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User: tempest-AttachVolumeTestJSON-945416102-project May 23 15:48:05.058319 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Domain-Id: default May 23 15:48:05.058319 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Domain-Name: Default May 23 15:48:05.058319 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Id: 5236a93fc3a84d27bf3d150e85eb2589 May 23 15:48:05.058319 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Name: tempest-AttachVolumeTestJSON-945416102-project May 23 15:48:05.058319 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: method: > May 23 15:48:05.058319 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: exception: Instance 53a161fc-db24-4861-8e60-b1e29465366e could not be found. May 23 15:48:05.058319 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: action_args: {'id': '53a161fc-db24-4861-8e60-b1e29465366e'} May 23 15:48:05.059124 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:48:05.059124 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:48:05.059124 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:48:05.059124 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:48:05.059124 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:48:05.059124 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:48:05.059124 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:48:05.059124 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:48:05.059124 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:48:05.059124 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:48:05.059124 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53a161fc-db24-4861-8e60-b1e29465366e could not be found. May 23 15:48:05.059124 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:48:05.059124 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:48:05.059124 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:48:05.059124 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:48:05.059124 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:48:05.059124 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:48:05.059124 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:48:05.059124 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:48:05.059124 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:48:05.060459 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:48:05.060459 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 15:48:05.060459 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 15:48:05.060459 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:48:05.060459 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:48:05.060459 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:48:05.060459 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:48:05.060459 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53a161fc-db24-4861-8e60-b1e29465366e could not be found. May 23 15:48:05.060459 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:48:05.060459 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:48:05.060459 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:48:05.060459 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:48:05.060459 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:48:05.060459 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:48:05.060459 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:48:05.060459 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:48:05.060459 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53a161fc-db24-4861-8e60-b1e29465366e could not be found. May 23 15:48:05.060459 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:48:05.061822 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-809f7cb3-79a0-4b2b-ad7e-7d89549001ef tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Returning 404 to user: Instance 53a161fc-db24-4861-8e60-b1e29465366e could not be found. {{(pid=124934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:48:05.061822 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-809f7cb3-79a0-4b2b-ad7e-7d89549001ef tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e" status: 404 len: 111 microversion: 2.1 time: 0.030598 May 23 15:48:05.061822 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 373/720] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:48:05 2022] GET /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 23 15:48:05.067104 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-a9fafb0b-f10b-4137-b166-ddae7269ec7b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '.version_select at 0x7fab51f90700>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:05.076303 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.network.neutron [None req-b8dc9d27-73e1-474c-81c2-2cb17ad1d144 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] validate_networks() for [('6b67b25e-d689-4151-bafc-c9d67faaca84', None, None, None, None, None)] {{(pid=124933) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 15:48:05.139095 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-a9fafb0b-f10b-4137-b166-ddae7269ec7b tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1058836153" status: 202 len: 0 microversion: 2.1 time: 0.075999 May 23 15:48:05.139854 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 374/721] 10.222.0.64 () {58 vars in 1220 bytes} [Mon May 23 15:48:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1058836153 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 23 15:48:05.275124 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-4ffcdc8f-e76f-450a-8a71-55f10f98c893 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:05.275786 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-4ffcdc8f-e76f-450a-8a71-55f10f98c893 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: 54ec3019-6a8e-4080-a386-3894a165c7eb] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:05.283680 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4ffcdc8f-e76f-450a-8a71-55f10f98c893 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:05.284118 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4ffcdc8f-e76f-450a-8a71-55f10f98c893 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:05.285019 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4ffcdc8f-e76f-450a-8a71-55f10f98c893 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:05.285489 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4ffcdc8f-e76f-450a-8a71-55f10f98c893 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:05.299851 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.wsgi [None req-4ffcdc8f-e76f-450a-8a71-55f10f98c893 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] HTTP exception thrown: Instance 54ec3019-6a8e-4080-a386-3894a165c7eb could not be found. May 23 15:48:05.301529 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-4ffcdc8f-e76f-450a-8a71-55f10f98c893 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Request method failure captured: May 23 15:48:05.301529 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: request: GET /compute/v2.1/servers/54ec3019-6a8e-4080-a386-3894a165c7eb HTTP/1.1 May 23 15:48:05.301529 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Accept: application/json May 23 15:48:05.301529 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Accept-Encoding: identity May 23 15:48:05.301529 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Connection: close May 23 15:48:05.301529 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Content-Length: 0 May 23 15:48:05.301529 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Content-Type: application/json May 23 15:48:05.301529 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Host: 10.222.0.64 May 23 15:48:05.301529 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Openstack-System-Scope: None May 23 15:48:05.301529 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: User-Agent: python-urllib3/1.26.9 May 23 15:48:05.301529 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Auth-Token: gAAAAABii6wE2FKLZmIEDzTgAa9WVqNGuAuBM4GxXFkOwLZ-Flh_qBqkvDmAt6NTTjKblb93vEokyS0BjtPlh4TqJHS4XW6qlkhQj7h-53hDatZ-dVYeoC-9Ze6Ke0SE_Sg4-M3XrzEBalVYIh8EnctJV8lL5krP2GdTXIxUEeR3aiQR3_eSvso May 23 15:48:05.301529 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Domain-Id: None May 23 15:48:05.301529 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Domain-Name: None May 23 15:48:05.301529 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Identity-Status: Confirmed May 23 15:48:05.301529 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Is-Admin-Project: True May 23 15:48:05.301529 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Domain-Id: default May 23 15:48:05.301529 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Domain-Name: Default May 23 15:48:05.301529 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Id: 6263581d20ea47bcae22d736f7934e05 May 23 15:48:05.301529 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Name: tempest-TestVolumeBootPattern-1449014178 May 23 15:48:05.301529 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Role: reader,member May 23 15:48:05.301529 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Roles: reader,member May 23 15:48:05.303185 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6263581d20ea47bcae22d736f7934e05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/6263581d20ea47bcae22d736f7934e05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6263581d20ea47bcae22d736f7934e05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_6263581d20ea47bcae22d736f7934e05", "adminURL": "http://10.222.0.64:8080"}]}] May 23 15:48:05.303185 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant: tempest-TestVolumeBootPattern-1449014178 May 23 15:48:05.303185 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant-Id: 6263581d20ea47bcae22d736f7934e05 May 23 15:48:05.303185 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant-Name: tempest-TestVolumeBootPattern-1449014178 May 23 15:48:05.303185 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User: tempest-TestVolumeBootPattern-1449014178-project May 23 15:48:05.303185 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Domain-Id: default May 23 15:48:05.303185 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Domain-Name: Default May 23 15:48:05.303185 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Id: ba0229c6732541b4a6dda9040c038686 May 23 15:48:05.303185 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Name: tempest-TestVolumeBootPattern-1449014178-project May 23 15:48:05.303185 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: method: > May 23 15:48:05.303185 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: exception: Instance 54ec3019-6a8e-4080-a386-3894a165c7eb could not be found. May 23 15:48:05.303185 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: action_args: {'id': '54ec3019-6a8e-4080-a386-3894a165c7eb'} May 23 15:48:05.304123 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:48:05.304123 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:48:05.304123 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:48:05.304123 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:48:05.304123 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:48:05.304123 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:48:05.304123 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:48:05.304123 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:48:05.304123 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:48:05.304123 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:48:05.304123 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54ec3019-6a8e-4080-a386-3894a165c7eb could not be found. May 23 15:48:05.304123 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:48:05.304123 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:48:05.304123 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:48:05.304123 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:48:05.304123 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:48:05.304123 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:48:05.304123 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:48:05.304123 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:48:05.304123 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:48:05.305622 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:48:05.305622 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 15:48:05.305622 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 15:48:05.305622 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:48:05.305622 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:48:05.305622 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:48:05.305622 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:48:05.305622 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54ec3019-6a8e-4080-a386-3894a165c7eb could not be found. May 23 15:48:05.305622 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:48:05.305622 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:48:05.305622 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:48:05.305622 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:48:05.305622 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:48:05.305622 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:48:05.305622 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:48:05.305622 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:48:05.305622 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54ec3019-6a8e-4080-a386-3894a165c7eb could not be found. May 23 15:48:05.305622 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:48:05.306972 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-4ffcdc8f-e76f-450a-8a71-55f10f98c893 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Returning 404 to user: Instance 54ec3019-6a8e-4080-a386-3894a165c7eb could not be found. {{(pid=124934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:48:05.306972 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-4ffcdc8f-e76f-450a-8a71-55f10f98c893 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/54ec3019-6a8e-4080-a386-3894a165c7eb" status: 404 len: 111 microversion: 2.1 time: 0.032242 May 23 15:48:05.310860 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 375/722] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:48:05 2022] GET /compute/v2.1/servers/54ec3019-6a8e-4080-a386-3894a165c7eb => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 23 15:48:05.418494 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-0ae99406-7227-4cb6-8a4e-c61759b4a3d7 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1201281155", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1689259836", "security_groups": [{"name": "tempest-secgroup-smoke-2071772138"}], "block_device_mapping_v2": [{"uuid": "7eebe9cc-0657-4ce9-b9e4-ac251d56a096", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "719fa7d2-b22e-4ff9-afc9-c7cbf4d644a6"}]}} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:48:05.565496 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.network.neutron [None req-0ae99406-7227-4cb6-8a4e-c61759b4a3d7 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] validate_networks() for [('719fa7d2-b22e-4ff9-afc9-c7cbf4d644a6', None, None, None, None, None)] {{(pid=124934) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 15:48:05.950762 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.virt.hardware [None req-b8dc9d27-73e1-474c-81c2-2cb17ad1d144 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Flavor limits 0:0:0 {{(pid=124933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 15:48:05.951329 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.virt.hardware [None req-b8dc9d27-73e1-474c-81c2-2cb17ad1d144 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Image limits 0:0:0 {{(pid=124933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 15:48:05.952064 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.virt.hardware [None req-b8dc9d27-73e1-474c-81c2-2cb17ad1d144 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Flavor pref 0:0:0 {{(pid=124933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 15:48:05.952705 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.virt.hardware [None req-b8dc9d27-73e1-474c-81c2-2cb17ad1d144 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Image pref 0:0:0 {{(pid=124933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 15:48:05.953293 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.virt.hardware [None req-b8dc9d27-73e1-474c-81c2-2cb17ad1d144 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 15:48:05.963729 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b8dc9d27-73e1-474c-81c2-2cb17ad1d144 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:05.964297 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b8dc9d27-73e1-474c-81c2-2cb17ad1d144 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:05.965276 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b8dc9d27-73e1-474c-81c2-2cb17ad1d144 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:05.966215 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b8dc9d27-73e1-474c-81c2-2cb17ad1d144 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:05.985299 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.quota [None req-b8dc9d27-73e1-474c-81c2-2cb17ad1d144 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Getting quotas for project a15ae9d15a64468f80628ed51c2e42d6. Resources: {'ram', 'instances', 'cores'} {{(pid=124933) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 15:48:05.993303 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.quota [None req-b8dc9d27-73e1-474c-81c2-2cb17ad1d144 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Getting quotas for user 472049224bbf48699b8a9410ec61aa9e and project a15ae9d15a64468f80628ed51c2e42d6. Resources: {'ram', 'instances', 'cores'} {{(pid=124933) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 15:48:06.004831 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-b8dc9d27-73e1-474c-81c2-2cb17ad1d144 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Going to run 1 instances... {{(pid=124933) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 15:48:06.007239 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-b8dc9d27-73e1-474c-81c2-2cb17ad1d144 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 78181bea-41e3-4044-b9e4-9c3700fb9037] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5c8503f-3733-426f-8a5b-c7c9358e4a45',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124933) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 15:48:06.092719 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.virt.hardware [None req-0ae99406-7227-4cb6-8a4e-c61759b4a3d7 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Flavor limits 0:0:0 {{(pid=124934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 15:48:06.093187 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.virt.hardware [None req-0ae99406-7227-4cb6-8a4e-c61759b4a3d7 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Image limits 0:0:0 {{(pid=124934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 15:48:06.093674 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.virt.hardware [None req-0ae99406-7227-4cb6-8a4e-c61759b4a3d7 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Flavor pref 0:0:0 {{(pid=124934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 15:48:06.094088 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.virt.hardware [None req-0ae99406-7227-4cb6-8a4e-c61759b4a3d7 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Image pref 0:0:0 {{(pid=124934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 15:48:06.098239 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.virt.hardware [None req-0ae99406-7227-4cb6-8a4e-c61759b4a3d7 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 15:48:06.103383 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0ae99406-7227-4cb6-8a4e-c61759b4a3d7 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:06.103902 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0ae99406-7227-4cb6-8a4e-c61759b4a3d7 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:06.104716 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0ae99406-7227-4cb6-8a4e-c61759b4a3d7 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:06.105248 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0ae99406-7227-4cb6-8a4e-c61759b4a3d7 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:06.122761 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.quota [None req-0ae99406-7227-4cb6-8a4e-c61759b4a3d7 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Getting quotas for project 6263581d20ea47bcae22d736f7934e05. Resources: {'ram', 'instances', 'cores'} {{(pid=124934) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 15:48:06.127927 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.quota [None req-0ae99406-7227-4cb6-8a4e-c61759b4a3d7 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Getting quotas for user ba0229c6732541b4a6dda9040c038686 and project 6263581d20ea47bcae22d736f7934e05. Resources: {'ram', 'instances', 'cores'} {{(pid=124934) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 15:48:06.184817 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-0ae99406-7227-4cb6-8a4e-c61759b4a3d7 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Going to run 1 instances... {{(pid=124934) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 15:48:06.187003 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-0ae99406-7227-4cb6-8a4e-c61759b4a3d7 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: e82853b8-ba61-4e2f-a961-7778da726303] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7eebe9cc-0657-4ce9-b9e4-ac251d56a096',volume_size=None,volume_type=None)] {{(pid=124934) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 15:48:06.202078 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b8dc9d27-73e1-474c-81c2-2cb17ad1d144 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [f77368d2-a953-48cf-91c8-b9f0b97fd46a] AMQP server on 10.222.0.64:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 23 15:48:06.809851 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-0ae99406-7227-4cb6-8a4e-c61759b4a3d7 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.395415 May 23 15:48:06.810484 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 376/723] 10.222.0.64 () {60 vars in 1146 bytes} [Mon May 23 15:48:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 1397 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 23 15:48:06.820866 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-a855b4fe-93a3-4363-b57c-c0a8900333e4 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:06.821508 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-a855b4fe-93a3-4363-b57c-c0a8900333e4 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: e82853b8-ba61-4e2f-a961-7778da726303] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:06.882089 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-a855b4fe-93a3-4363-b57c-c0a8900333e4 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:06.888652 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-a855b4fe-93a3-4363-b57c-c0a8900333e4 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/e82853b8-ba61-4e2f-a961-7778da726303" status: 200 len: 1095 microversion: 2.1 time: 0.071622 May 23 15:48:06.889296 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 377/724] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:48:06 2022] GET /compute/v2.1/servers/e82853b8-ba61-4e2f-a961-7778da726303 => generated 1095 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:48:07.211164 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO oslo.messaging._drivers.impl_rabbit [None req-b8dc9d27-73e1-474c-81c2-2cb17ad1d144 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [f77368d2-a953-48cf-91c8-b9f0b97fd46a] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 38200. May 23 15:48:07.215259 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-b8dc9d27-73e1-474c-81c2-2cb17ad1d144 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.246115 May 23 15:48:07.216048 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 348/725] 10.222.0.64 () {60 vars in 1146 bytes} [Mon May 23 15:48:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 2248 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 15:48:07.226587 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-345caf42-e7e6-4549-81ce-7f03ac1eae2c tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:07.227419 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-345caf42-e7e6-4549-81ce-7f03ac1eae2c tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 78181bea-41e3-4044-b9e4-9c3700fb9037] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:07.283386 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-345caf42-e7e6-4549-81ce-7f03ac1eae2c tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:07.290955 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-345caf42-e7e6-4549-81ce-7f03ac1eae2c tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/78181bea-41e3-4044-b9e4-9c3700fb9037" status: 200 len: 1241 microversion: 2.1 time: 0.068774 May 23 15:48:07.300782 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 378/726] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:48:07 2022] GET /compute/v2.1/servers/78181bea-41e3-4044-b9e4-9c3700fb9037 => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:48:07.906376 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-0d1417c2-1968-4c93-9fe3-6acc1164b4e4 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:07.912980 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-0d1417c2-1968-4c93-9fe3-6acc1164b4e4 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: e82853b8-ba61-4e2f-a961-7778da726303] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:07.915754 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-0d1417c2-1968-4c93-9fe3-6acc1164b4e4 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:07.916203 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-0d1417c2-1968-4c93-9fe3-6acc1164b4e4 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:07.916999 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-0d1417c2-1968-4c93-9fe3-6acc1164b4e4 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:07.917735 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-0d1417c2-1968-4c93-9fe3-6acc1164b4e4 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:07.982346 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-0d1417c2-1968-4c93-9fe3-6acc1164b4e4 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:07.990129 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-0d1417c2-1968-4c93-9fe3-6acc1164b4e4 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/e82853b8-ba61-4e2f-a961-7778da726303" status: 200 len: 1145 microversion: 2.1 time: 0.087622 May 23 15:48:07.990715 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 349/727] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:48:07 2022] GET /compute/v2.1/servers/e82853b8-ba61-4e2f-a961-7778da726303 => generated 1145 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:48:08.307632 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-e5880237-397b-4b84-989a-95d39762fa09 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:08.308250 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-e5880237-397b-4b84-989a-95d39762fa09 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 78181bea-41e3-4044-b9e4-9c3700fb9037] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:08.310704 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:48:08.316163 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e5880237-397b-4b84-989a-95d39762fa09 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:08.316623 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e5880237-397b-4b84-989a-95d39762fa09 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:08.317427 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e5880237-397b-4b84-989a-95d39762fa09 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:08.317922 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e5880237-397b-4b84-989a-95d39762fa09 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:08.378632 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-e5880237-397b-4b84-989a-95d39762fa09 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:08.386214 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-e5880237-397b-4b84-989a-95d39762fa09 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/78181bea-41e3-4044-b9e4-9c3700fb9037" status: 200 len: 1245 microversion: 2.1 time: 0.082418 May 23 15:48:08.386792 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 379/728] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:48:08 2022] GET /compute/v2.1/servers/78181bea-41e3-4044-b9e4-9c3700fb9037 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:48:08.618856 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-5626a1f4-d447-4cc6-a19c-34c88c1f4937 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:08.619341 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-5626a1f4-d447-4cc6-a19c-34c88c1f4937 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 53a161fc-db24-4861-8e60-b1e29465366e] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:08.625389 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-5626a1f4-d447-4cc6-a19c-34c88c1f4937 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:08.625846 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-5626a1f4-d447-4cc6-a19c-34c88c1f4937 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:08.626615 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-5626a1f4-d447-4cc6-a19c-34c88c1f4937 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:08.627770 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-5626a1f4-d447-4cc6-a19c-34c88c1f4937 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:08.640855 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.wsgi [None req-5626a1f4-d447-4cc6-a19c-34c88c1f4937 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] HTTP exception thrown: Instance 53a161fc-db24-4861-8e60-b1e29465366e could not be found. May 23 15:48:08.643176 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-5626a1f4-d447-4cc6-a19c-34c88c1f4937 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Request method failure captured: May 23 15:48:08.643176 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: request: DELETE /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e HTTP/1.1 May 23 15:48:08.643176 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Accept: application/json May 23 15:48:08.643176 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Accept-Encoding: identity May 23 15:48:08.643176 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Connection: close May 23 15:48:08.643176 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Content-Length: 0 May 23 15:48:08.643176 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Content-Type: application/json May 23 15:48:08.643176 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Host: 10.222.0.64 May 23 15:48:08.643176 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Openstack-System-Scope: None May 23 15:48:08.643176 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: User-Agent: python-urllib3/1.26.9 May 23 15:48:08.643176 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Auth-Token: gAAAAABii6s5te8GOjKrfAiv0Xf4k5hpEIekrfbYkgWsUlONJEd5IzBjOwa-F0NrdS9U2FReEjSKki20nknUbrI8hjkEKlGxJYFyk8iHUDzAljl1LnKqWL1Ulq6dP7R2suSMvGgQbwdVVqnorKIgEad5uHXYWrgLbilvMKjMAuNuN-pGwRi0zuM May 23 15:48:08.643176 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Domain-Id: None May 23 15:48:08.643176 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Domain-Name: None May 23 15:48:08.643176 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Identity-Status: Confirmed May 23 15:48:08.643176 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Is-Admin-Project: True May 23 15:48:08.643176 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Domain-Id: default May 23 15:48:08.643176 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Domain-Name: Default May 23 15:48:08.643176 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Id: 8d7ac236cd4d414fb70eb8da6da53484 May 23 15:48:08.643176 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Name: tempest-AttachVolumeTestJSON-945416102 May 23 15:48:08.643176 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Role: reader,member May 23 15:48:08.643176 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Roles: reader,member May 23 15:48:08.644799 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/8d7ac236cd4d414fb70eb8da6da53484"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/8d7ac236cd4d414fb70eb8da6da53484"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/8d7ac236cd4d414fb70eb8da6da53484"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_8d7ac236cd4d414fb70eb8da6da53484", "adminURL": "http://10.222.0.64:8080"}]}] May 23 15:48:08.644799 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant: tempest-AttachVolumeTestJSON-945416102 May 23 15:48:08.644799 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant-Id: 8d7ac236cd4d414fb70eb8da6da53484 May 23 15:48:08.644799 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant-Name: tempest-AttachVolumeTestJSON-945416102 May 23 15:48:08.644799 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User: tempest-AttachVolumeTestJSON-945416102-project May 23 15:48:08.644799 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Domain-Id: default May 23 15:48:08.644799 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Domain-Name: Default May 23 15:48:08.644799 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Id: 5236a93fc3a84d27bf3d150e85eb2589 May 23 15:48:08.644799 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Name: tempest-AttachVolumeTestJSON-945416102-project May 23 15:48:08.644799 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: method: > May 23 15:48:08.644799 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: exception: Instance 53a161fc-db24-4861-8e60-b1e29465366e could not be found. May 23 15:48:08.644799 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: action_args: {'id': '53a161fc-db24-4861-8e60-b1e29465366e'} May 23 15:48:08.645726 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:48:08.645726 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:48:08.645726 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:48:08.645726 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:48:08.645726 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:48:08.645726 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:48:08.645726 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:48:08.645726 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:48:08.645726 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:48:08.645726 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:48:08.645726 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53a161fc-db24-4861-8e60-b1e29465366e could not be found. May 23 15:48:08.645726 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:48:08.645726 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:48:08.645726 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:48:08.645726 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:48:08.645726 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:48:08.645726 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:48:08.645726 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:48:08.645726 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:48:08.645726 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:48:08.647230 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:48:08.647230 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 15:48:08.647230 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 15:48:08.647230 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 15:48:08.647230 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 15:48:08.647230 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:48:08.647230 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:48:08.647230 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:48:08.647230 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:48:08.647230 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53a161fc-db24-4861-8e60-b1e29465366e could not be found. May 23 15:48:08.647230 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:48:08.647230 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:48:08.647230 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:48:08.647230 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:48:08.647230 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:48:08.647230 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:48:08.647230 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:48:08.647230 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:48:08.647230 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53a161fc-db24-4861-8e60-b1e29465366e could not be found. May 23 15:48:08.647230 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:48:08.648731 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-5626a1f4-d447-4cc6-a19c-34c88c1f4937 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Returning 404 to user: Instance 53a161fc-db24-4861-8e60-b1e29465366e could not be found. {{(pid=124933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:48:08.648731 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-5626a1f4-d447-4cc6-a19c-34c88c1f4937 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "DELETE /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e" status: 404 len: 111 microversion: 2.1 time: 0.029629 May 23 15:48:08.648731 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 350/729] 10.222.0.64 () {58 vars in 1238 bytes} [Mon May 23 15:48:08 2022] DELETE /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 15:48:08.653292 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-4b3048a7-00f1-46a0-92c5-9ca6b7ae96f5 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:08.653904 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-4b3048a7-00f1-46a0-92c5-9ca6b7ae96f5 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 53a161fc-db24-4861-8e60-b1e29465366e] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:08.660474 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4b3048a7-00f1-46a0-92c5-9ca6b7ae96f5 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:08.660904 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4b3048a7-00f1-46a0-92c5-9ca6b7ae96f5 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:08.661695 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4b3048a7-00f1-46a0-92c5-9ca6b7ae96f5 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:08.662132 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4b3048a7-00f1-46a0-92c5-9ca6b7ae96f5 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:08.675221 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.wsgi [None req-4b3048a7-00f1-46a0-92c5-9ca6b7ae96f5 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] HTTP exception thrown: Instance 53a161fc-db24-4861-8e60-b1e29465366e could not be found. May 23 15:48:08.676716 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-4b3048a7-00f1-46a0-92c5-9ca6b7ae96f5 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Request method failure captured: May 23 15:48:08.676716 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: request: GET /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e HTTP/1.1 May 23 15:48:08.676716 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Accept: application/json May 23 15:48:08.676716 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Accept-Encoding: identity May 23 15:48:08.676716 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Connection: close May 23 15:48:08.676716 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Content-Length: 0 May 23 15:48:08.676716 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Content-Type: application/json May 23 15:48:08.676716 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Host: 10.222.0.64 May 23 15:48:08.676716 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Openstack-System-Scope: None May 23 15:48:08.676716 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: User-Agent: python-urllib3/1.26.9 May 23 15:48:08.676716 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Auth-Token: gAAAAABii6s5te8GOjKrfAiv0Xf4k5hpEIekrfbYkgWsUlONJEd5IzBjOwa-F0NrdS9U2FReEjSKki20nknUbrI8hjkEKlGxJYFyk8iHUDzAljl1LnKqWL1Ulq6dP7R2suSMvGgQbwdVVqnorKIgEad5uHXYWrgLbilvMKjMAuNuN-pGwRi0zuM May 23 15:48:08.676716 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Domain-Id: None May 23 15:48:08.676716 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Domain-Name: None May 23 15:48:08.676716 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Identity-Status: Confirmed May 23 15:48:08.676716 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Is-Admin-Project: True May 23 15:48:08.676716 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Domain-Id: default May 23 15:48:08.676716 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Domain-Name: Default May 23 15:48:08.676716 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Id: 8d7ac236cd4d414fb70eb8da6da53484 May 23 15:48:08.676716 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Name: tempest-AttachVolumeTestJSON-945416102 May 23 15:48:08.676716 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Role: reader,member May 23 15:48:08.676716 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Roles: reader,member May 23 15:48:08.678314 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/8d7ac236cd4d414fb70eb8da6da53484"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/8d7ac236cd4d414fb70eb8da6da53484"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/8d7ac236cd4d414fb70eb8da6da53484"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_8d7ac236cd4d414fb70eb8da6da53484", "adminURL": "http://10.222.0.64:8080"}]}] May 23 15:48:08.678314 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant: tempest-AttachVolumeTestJSON-945416102 May 23 15:48:08.678314 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant-Id: 8d7ac236cd4d414fb70eb8da6da53484 May 23 15:48:08.678314 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant-Name: tempest-AttachVolumeTestJSON-945416102 May 23 15:48:08.678314 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User: tempest-AttachVolumeTestJSON-945416102-project May 23 15:48:08.678314 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Domain-Id: default May 23 15:48:08.678314 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Domain-Name: Default May 23 15:48:08.678314 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Id: 5236a93fc3a84d27bf3d150e85eb2589 May 23 15:48:08.678314 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Name: tempest-AttachVolumeTestJSON-945416102-project May 23 15:48:08.678314 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: method: > May 23 15:48:08.678314 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: exception: Instance 53a161fc-db24-4861-8e60-b1e29465366e could not be found. May 23 15:48:08.678314 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: action_args: {'id': '53a161fc-db24-4861-8e60-b1e29465366e'} May 23 15:48:08.679131 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:48:08.679131 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:48:08.679131 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:48:08.679131 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:48:08.679131 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:48:08.679131 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:48:08.679131 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:48:08.679131 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:48:08.679131 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:48:08.679131 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:48:08.679131 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53a161fc-db24-4861-8e60-b1e29465366e could not be found. May 23 15:48:08.679131 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:48:08.679131 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:48:08.679131 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:48:08.679131 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:48:08.679131 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:48:08.679131 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:48:08.679131 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:48:08.679131 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:48:08.679131 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:48:08.680601 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:48:08.680601 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 15:48:08.680601 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 15:48:08.680601 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:48:08.680601 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:48:08.680601 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:48:08.680601 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:48:08.680601 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53a161fc-db24-4861-8e60-b1e29465366e could not be found. May 23 15:48:08.680601 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:48:08.680601 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:48:08.680601 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:48:08.680601 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:48:08.680601 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:48:08.680601 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:48:08.680601 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:48:08.680601 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:48:08.680601 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53a161fc-db24-4861-8e60-b1e29465366e could not be found. May 23 15:48:08.680601 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:48:08.681939 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-4b3048a7-00f1-46a0-92c5-9ca6b7ae96f5 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Returning 404 to user: Instance 53a161fc-db24-4861-8e60-b1e29465366e could not be found. {{(pid=124934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:48:08.681939 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-4b3048a7-00f1-46a0-92c5-9ca6b7ae96f5 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e" status: 404 len: 111 microversion: 2.1 time: 0.028983 May 23 15:48:08.681939 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 380/730] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:48:08 2022] GET /compute/v2.1/servers/53a161fc-db24-4861-8e60-b1e29465366e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 15:48:09.007564 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-401cf7d7-d2d3-4310-ba4a-ec6395b7a9a9 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:09.008169 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-401cf7d7-d2d3-4310-ba4a-ec6395b7a9a9 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: e82853b8-ba61-4e2f-a961-7778da726303] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:09.014709 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-401cf7d7-d2d3-4310-ba4a-ec6395b7a9a9 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:09.015154 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-401cf7d7-d2d3-4310-ba4a-ec6395b7a9a9 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:09.017295 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-401cf7d7-d2d3-4310-ba4a-ec6395b7a9a9 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:09.017295 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-401cf7d7-d2d3-4310-ba4a-ec6395b7a9a9 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:09.081123 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-401cf7d7-d2d3-4310-ba4a-ec6395b7a9a9 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:09.088559 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-401cf7d7-d2d3-4310-ba4a-ec6395b7a9a9 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/e82853b8-ba61-4e2f-a961-7778da726303" status: 200 len: 1193 microversion: 2.1 time: 0.084748 May 23 15:48:09.089137 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 351/731] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:48:09 2022] GET /compute/v2.1/servers/e82853b8-ba61-4e2f-a961-7778da726303 => generated 1193 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:48:09.402878 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-5621056b-63bb-44d2-9e1e-aaef03ffcac9 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:09.403632 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-5621056b-63bb-44d2-9e1e-aaef03ffcac9 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 78181bea-41e3-4044-b9e4-9c3700fb9037] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:09.411214 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5621056b-63bb-44d2-9e1e-aaef03ffcac9 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:09.411671 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5621056b-63bb-44d2-9e1e-aaef03ffcac9 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:09.412447 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5621056b-63bb-44d2-9e1e-aaef03ffcac9 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:09.412889 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5621056b-63bb-44d2-9e1e-aaef03ffcac9 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:09.480742 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-5621056b-63bb-44d2-9e1e-aaef03ffcac9 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:09.488526 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-5621056b-63bb-44d2-9e1e-aaef03ffcac9 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/78181bea-41e3-4044-b9e4-9c3700fb9037" status: 200 len: 1293 microversion: 2.1 time: 0.089514 May 23 15:48:09.489125 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 381/732] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:48:09 2022] GET /compute/v2.1/servers/78181bea-41e3-4044-b9e4-9c3700fb9037 => generated 1293 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:48:10.004965 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-525fd88d-67f9-4f8c-8718-dbb7db5ed1c1 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:10.005927 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-525fd88d-67f9-4f8c-8718-dbb7db5ed1c1 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:10.011993 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:INSERT=4 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:48:10.014387 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-525fd88d-67f9-4f8c-8718-dbb7db5ed1c1 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:10.026160 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-525fd88d-67f9-4f8c-8718-dbb7db5ed1c1 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:10.026160 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-525fd88d-67f9-4f8c-8718-dbb7db5ed1c1 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:10.026160 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-525fd88d-67f9-4f8c-8718-dbb7db5ed1c1 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:10.031205 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.wsgi [None req-525fd88d-67f9-4f8c-8718-dbb7db5ed1c1 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] HTTP exception thrown: Instance 800dd67c-e6dd-4712-9fe6-8d823b845358 could not be found. May 23 15:48:10.033624 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-525fd88d-67f9-4f8c-8718-dbb7db5ed1c1 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Request method failure captured: May 23 15:48:10.033624 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: request: DELETE /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 HTTP/1.1 May 23 15:48:10.033624 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Accept: application/json May 23 15:48:10.033624 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Accept-Encoding: identity May 23 15:48:10.033624 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Connection: close May 23 15:48:10.033624 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Content-Length: 0 May 23 15:48:10.033624 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Content-Type: application/json May 23 15:48:10.033624 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Host: 10.222.0.64 May 23 15:48:10.033624 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Openstack-System-Scope: None May 23 15:48:10.033624 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: User-Agent: python-urllib3/1.26.9 May 23 15:48:10.033624 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Auth-Token: gAAAAABii6s5te8GOjKrfAiv0Xf4k5hpEIekrfbYkgWsUlONJEd5IzBjOwa-F0NrdS9U2FReEjSKki20nknUbrI8hjkEKlGxJYFyk8iHUDzAljl1LnKqWL1Ulq6dP7R2suSMvGgQbwdVVqnorKIgEad5uHXYWrgLbilvMKjMAuNuN-pGwRi0zuM May 23 15:48:10.033624 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Domain-Id: None May 23 15:48:10.033624 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Domain-Name: None May 23 15:48:10.033624 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Identity-Status: Confirmed May 23 15:48:10.033624 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Is-Admin-Project: True May 23 15:48:10.033624 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Domain-Id: default May 23 15:48:10.033624 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Domain-Name: Default May 23 15:48:10.033624 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Id: 8d7ac236cd4d414fb70eb8da6da53484 May 23 15:48:10.033624 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Name: tempest-AttachVolumeTestJSON-945416102 May 23 15:48:10.033624 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Role: reader,member May 23 15:48:10.033624 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Roles: reader,member May 23 15:48:10.035814 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/8d7ac236cd4d414fb70eb8da6da53484"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/8d7ac236cd4d414fb70eb8da6da53484"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/8d7ac236cd4d414fb70eb8da6da53484"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_8d7ac236cd4d414fb70eb8da6da53484", "adminURL": "http://10.222.0.64:8080"}]}] May 23 15:48:10.035814 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant: tempest-AttachVolumeTestJSON-945416102 May 23 15:48:10.035814 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant-Id: 8d7ac236cd4d414fb70eb8da6da53484 May 23 15:48:10.035814 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant-Name: tempest-AttachVolumeTestJSON-945416102 May 23 15:48:10.035814 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User: tempest-AttachVolumeTestJSON-945416102-project May 23 15:48:10.035814 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Domain-Id: default May 23 15:48:10.035814 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Domain-Name: Default May 23 15:48:10.035814 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Id: 5236a93fc3a84d27bf3d150e85eb2589 May 23 15:48:10.035814 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Name: tempest-AttachVolumeTestJSON-945416102-project May 23 15:48:10.035814 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: method: > May 23 15:48:10.035814 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: exception: Instance 800dd67c-e6dd-4712-9fe6-8d823b845358 could not be found. May 23 15:48:10.035814 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: action_args: {'id': '800dd67c-e6dd-4712-9fe6-8d823b845358'} May 23 15:48:10.036700 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:48:10.036700 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:48:10.036700 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:48:10.036700 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:48:10.036700 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:48:10.036700 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:48:10.036700 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:48:10.036700 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:48:10.036700 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:48:10.036700 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:48:10.036700 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 800dd67c-e6dd-4712-9fe6-8d823b845358 could not be found. May 23 15:48:10.036700 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:48:10.036700 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:48:10.036700 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:48:10.036700 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:48:10.036700 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:48:10.036700 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:48:10.036700 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:48:10.036700 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:48:10.036700 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:48:10.038194 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:48:10.038194 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 15:48:10.038194 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 15:48:10.038194 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 15:48:10.038194 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 15:48:10.038194 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:48:10.038194 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:48:10.038194 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:48:10.038194 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:48:10.038194 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 800dd67c-e6dd-4712-9fe6-8d823b845358 could not be found. May 23 15:48:10.038194 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:48:10.038194 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:48:10.038194 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:48:10.038194 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:48:10.038194 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:48:10.038194 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:48:10.038194 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:48:10.038194 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:48:10.038194 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 800dd67c-e6dd-4712-9fe6-8d823b845358 could not be found. May 23 15:48:10.038194 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:48:10.039605 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-525fd88d-67f9-4f8c-8718-dbb7db5ed1c1 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Returning 404 to user: Instance 800dd67c-e6dd-4712-9fe6-8d823b845358 could not be found. {{(pid=124933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:48:10.039605 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-525fd88d-67f9-4f8c-8718-dbb7db5ed1c1 tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "DELETE /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 404 len: 111 microversion: 2.1 time: 0.034337 May 23 15:48:10.039605 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 352/733] 10.222.0.64 () {58 vars in 1238 bytes} [Mon May 23 15:48:09 2022] DELETE /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 15:48:10.043991 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-e5cfa61f-f070-4b69-a9f9-1f9931c8fbeb tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:10.044645 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-e5cfa61f-f070-4b69-a9f9-1f9931c8fbeb tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] [instance: 800dd67c-e6dd-4712-9fe6-8d823b845358] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:10.051334 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e5cfa61f-f070-4b69-a9f9-1f9931c8fbeb tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:10.051796 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e5cfa61f-f070-4b69-a9f9-1f9931c8fbeb tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:10.052979 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e5cfa61f-f070-4b69-a9f9-1f9931c8fbeb tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:10.053630 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e5cfa61f-f070-4b69-a9f9-1f9931c8fbeb tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:10.069970 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.wsgi [None req-e5cfa61f-f070-4b69-a9f9-1f9931c8fbeb tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] HTTP exception thrown: Instance 800dd67c-e6dd-4712-9fe6-8d823b845358 could not be found. May 23 15:48:10.071163 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-e5cfa61f-f070-4b69-a9f9-1f9931c8fbeb tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Request method failure captured: May 23 15:48:10.071163 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: request: GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 HTTP/1.1 May 23 15:48:10.071163 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Accept: application/json May 23 15:48:10.071163 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Accept-Encoding: identity May 23 15:48:10.071163 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Connection: close May 23 15:48:10.071163 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Content-Length: 0 May 23 15:48:10.071163 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Content-Type: application/json May 23 15:48:10.071163 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Host: 10.222.0.64 May 23 15:48:10.071163 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Openstack-System-Scope: None May 23 15:48:10.071163 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: User-Agent: python-urllib3/1.26.9 May 23 15:48:10.071163 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Auth-Token: gAAAAABii6s5te8GOjKrfAiv0Xf4k5hpEIekrfbYkgWsUlONJEd5IzBjOwa-F0NrdS9U2FReEjSKki20nknUbrI8hjkEKlGxJYFyk8iHUDzAljl1LnKqWL1Ulq6dP7R2suSMvGgQbwdVVqnorKIgEad5uHXYWrgLbilvMKjMAuNuN-pGwRi0zuM May 23 15:48:10.071163 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Domain-Id: None May 23 15:48:10.071163 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Domain-Name: None May 23 15:48:10.071163 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Identity-Status: Confirmed May 23 15:48:10.071163 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Is-Admin-Project: True May 23 15:48:10.071163 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Domain-Id: default May 23 15:48:10.071163 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Domain-Name: Default May 23 15:48:10.071163 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Id: 8d7ac236cd4d414fb70eb8da6da53484 May 23 15:48:10.071163 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Name: tempest-AttachVolumeTestJSON-945416102 May 23 15:48:10.071163 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Role: reader,member May 23 15:48:10.071163 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Roles: reader,member May 23 15:48:10.072748 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/8d7ac236cd4d414fb70eb8da6da53484"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/8d7ac236cd4d414fb70eb8da6da53484"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/8d7ac236cd4d414fb70eb8da6da53484"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_8d7ac236cd4d414fb70eb8da6da53484", "adminURL": "http://10.222.0.64:8080"}]}] May 23 15:48:10.072748 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant: tempest-AttachVolumeTestJSON-945416102 May 23 15:48:10.072748 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant-Id: 8d7ac236cd4d414fb70eb8da6da53484 May 23 15:48:10.072748 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant-Name: tempest-AttachVolumeTestJSON-945416102 May 23 15:48:10.072748 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User: tempest-AttachVolumeTestJSON-945416102-project May 23 15:48:10.072748 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Domain-Id: default May 23 15:48:10.072748 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Domain-Name: Default May 23 15:48:10.072748 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Id: 5236a93fc3a84d27bf3d150e85eb2589 May 23 15:48:10.072748 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Name: tempest-AttachVolumeTestJSON-945416102-project May 23 15:48:10.072748 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: method: > May 23 15:48:10.072748 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: exception: Instance 800dd67c-e6dd-4712-9fe6-8d823b845358 could not be found. May 23 15:48:10.072748 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: action_args: {'id': '800dd67c-e6dd-4712-9fe6-8d823b845358'} May 23 15:48:10.073669 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:48:10.073669 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:48:10.073669 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:48:10.073669 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:48:10.073669 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:48:10.073669 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:48:10.073669 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:48:10.073669 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:48:10.073669 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:48:10.073669 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:48:10.073669 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 800dd67c-e6dd-4712-9fe6-8d823b845358 could not be found. May 23 15:48:10.073669 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:48:10.073669 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:48:10.073669 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:48:10.073669 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:48:10.073669 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:48:10.073669 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:48:10.073669 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:48:10.073669 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:48:10.073669 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:48:10.075235 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:48:10.075235 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 15:48:10.075235 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 15:48:10.075235 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:48:10.075235 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:48:10.075235 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:48:10.075235 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:48:10.075235 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 800dd67c-e6dd-4712-9fe6-8d823b845358 could not be found. May 23 15:48:10.075235 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:48:10.075235 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:48:10.075235 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:48:10.075235 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:48:10.075235 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:48:10.075235 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:48:10.075235 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:48:10.075235 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:48:10.075235 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 800dd67c-e6dd-4712-9fe6-8d823b845358 could not be found. May 23 15:48:10.075235 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:48:10.076698 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-e5cfa61f-f070-4b69-a9f9-1f9931c8fbeb tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] Returning 404 to user: Instance 800dd67c-e6dd-4712-9fe6-8d823b845358 could not be found. {{(pid=124934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:48:10.076698 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-e5cfa61f-f070-4b69-a9f9-1f9931c8fbeb tempest-AttachVolumeTestJSON-945416102 tempest-AttachVolumeTestJSON-945416102-project] 10.222.0.64 "GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358" status: 404 len: 111 microversion: 2.1 time: 0.032925 May 23 15:48:10.083304 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 382/734] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:48:10 2022] GET /compute/v2.1/servers/800dd67c-e6dd-4712-9fe6-8d823b845358 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 15:48:10.106022 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-7012ce37-f653-44e6-bb7e-e07981442033 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:10.106496 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-7012ce37-f653-44e6-bb7e-e07981442033 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: e82853b8-ba61-4e2f-a961-7778da726303] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:10.114762 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-7012ce37-f653-44e6-bb7e-e07981442033 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:10.115357 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-7012ce37-f653-44e6-bb7e-e07981442033 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:10.116344 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-7012ce37-f653-44e6-bb7e-e07981442033 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:10.116901 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-7012ce37-f653-44e6-bb7e-e07981442033 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:10.436405 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-7012ce37-f653-44e6-bb7e-e07981442033 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:10.447083 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-7012ce37-f653-44e6-bb7e-e07981442033 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/e82853b8-ba61-4e2f-a961-7778da726303" status: 200 len: 1279 microversion: 2.1 time: 0.344563 May 23 15:48:10.458113 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 353/735] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:48:10 2022] GET /compute/v2.1/servers/e82853b8-ba61-4e2f-a961-7778da726303 => generated 1279 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:48:10.506238 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-05f2d96d-bdb9-4cd2-8201-acc25641e273 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:10.506863 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-05f2d96d-bdb9-4cd2-8201-acc25641e273 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 78181bea-41e3-4044-b9e4-9c3700fb9037] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:10.513222 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-05f2d96d-bdb9-4cd2-8201-acc25641e273 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:10.513692 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-05f2d96d-bdb9-4cd2-8201-acc25641e273 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:10.514510 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-05f2d96d-bdb9-4cd2-8201-acc25641e273 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:10.515118 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-05f2d96d-bdb9-4cd2-8201-acc25641e273 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:10.647187 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-05f2d96d-bdb9-4cd2-8201-acc25641e273 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:10.656121 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-05f2d96d-bdb9-4cd2-8201-acc25641e273 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/78181bea-41e3-4044-b9e4-9c3700fb9037" status: 200 len: 1311 microversion: 2.1 time: 0.154425 May 23 15:48:10.656828 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 383/736] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:48:10 2022] GET /compute/v2.1/servers/78181bea-41e3-4044-b9e4-9c3700fb9037 => generated 1311 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:48:11.478861 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-171c17b6-6206-42e2-9ff8-4a79faefee95 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:11.484729 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-171c17b6-6206-42e2-9ff8-4a79faefee95 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: e82853b8-ba61-4e2f-a961-7778da726303] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:11.491868 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-171c17b6-6206-42e2-9ff8-4a79faefee95 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:11.492320 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-171c17b6-6206-42e2-9ff8-4a79faefee95 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:11.493128 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-171c17b6-6206-42e2-9ff8-4a79faefee95 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:11.493741 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-171c17b6-6206-42e2-9ff8-4a79faefee95 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:11.529920 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [req-55ae610b-7f7c-488f-8bdc-1a91470c72b6 req-e03f9350-cb49-4ef3-96cd-7d3e9b7c3c8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e82853b8-ba61-4e2f-a961-7778da726303", "tag": "557925ff-a601-4157-8dce-7678d594e516"}]} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:48:11.563466 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-55ae610b-7f7c-488f-8bdc-1a91470c72b6 req-e03f9350-cb49-4ef3-96cd-7d3e9b7c3c8e service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:11.565416 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-55ae610b-7f7c-488f-8bdc-1a91470c72b6 req-e03f9350-cb49-4ef3-96cd-7d3e9b7c3c8e service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:11.586274 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.compute.server_external_events [req-55ae610b-7f7c-488f-8bdc-1a91470c72b6 req-e03f9350-cb49-4ef3-96cd-7d3e9b7c3c8e service nova] Creating event network-changed:557925ff-a601-4157-8dce-7678d594e516 for instance e82853b8-ba61-4e2f-a961-7778da726303 on hv-cinder-84067 May 23 15:48:11.593837 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [req-55ae610b-7f7c-488f-8bdc-1a91470c72b6 req-e03f9350-cb49-4ef3-96cd-7d3e9b7c3c8e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070170 May 23 15:48:11.595575 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 384/737] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:48:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:48:11.674876 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-a7b92a2d-a9d2-45f0-9a63-0ed8c05ee919 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:11.675954 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-a7b92a2d-a9d2-45f0-9a63-0ed8c05ee919 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 78181bea-41e3-4044-b9e4-9c3700fb9037] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:11.687223 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-a7b92a2d-a9d2-45f0-9a63-0ed8c05ee919 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:11.687687 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-a7b92a2d-a9d2-45f0-9a63-0ed8c05ee919 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:11.688724 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-a7b92a2d-a9d2-45f0-9a63-0ed8c05ee919 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:11.689398 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-a7b92a2d-a9d2-45f0-9a63-0ed8c05ee919 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:11.985670 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-171c17b6-6206-42e2-9ff8-4a79faefee95 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:11.997012 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-171c17b6-6206-42e2-9ff8-4a79faefee95 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/e82853b8-ba61-4e2f-a961-7778da726303" status: 200 len: 1267 microversion: 2.1 time: 0.534945 May 23 15:48:11.997801 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 354/738] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:48:11 2022] GET /compute/v2.1/servers/e82853b8-ba61-4e2f-a961-7778da726303 => generated 1267 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:48:12.121977 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-a7b92a2d-a9d2-45f0-9a63-0ed8c05ee919 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:12.130146 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-a7b92a2d-a9d2-45f0-9a63-0ed8c05ee919 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/78181bea-41e3-4044-b9e4-9c3700fb9037" status: 200 len: 1366 microversion: 2.1 time: 0.460279 May 23 15:48:12.133091 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 385/739] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:48:11 2022] GET /compute/v2.1/servers/78181bea-41e3-4044-b9e4-9c3700fb9037 => generated 1366 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:48:13.015165 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-c343b5cf-9577-4c09-a9e3-10cc34d14461 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:13.015833 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-c343b5cf-9577-4c09-a9e3-10cc34d14461 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: e82853b8-ba61-4e2f-a961-7778da726303] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:13.026547 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c343b5cf-9577-4c09-a9e3-10cc34d14461 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:13.027006 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c343b5cf-9577-4c09-a9e3-10cc34d14461 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:13.027800 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c343b5cf-9577-4c09-a9e3-10cc34d14461 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:13.028232 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c343b5cf-9577-4c09-a9e3-10cc34d14461 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:13.147352 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-1d39cf30-6ee5-4890-888b-896940ac6656 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:13.147975 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-1d39cf30-6ee5-4890-888b-896940ac6656 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 78181bea-41e3-4044-b9e4-9c3700fb9037] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:13.155152 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-1d39cf30-6ee5-4890-888b-896940ac6656 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:13.155606 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-1d39cf30-6ee5-4890-888b-896940ac6656 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:13.156595 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-1d39cf30-6ee5-4890-888b-896940ac6656 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:13.157038 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-1d39cf30-6ee5-4890-888b-896940ac6656 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:13.355553 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-c343b5cf-9577-4c09-a9e3-10cc34d14461 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:13.368646 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-c343b5cf-9577-4c09-a9e3-10cc34d14461 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/e82853b8-ba61-4e2f-a961-7778da726303" status: 200 len: 1267 microversion: 2.1 time: 0.357581 May 23 15:48:13.372612 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 355/740] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:48:13 2022] GET /compute/v2.1/servers/e82853b8-ba61-4e2f-a961-7778da726303 => generated 1267 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:48:13.401514 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-1d39cf30-6ee5-4890-888b-896940ac6656 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:13.413681 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-1d39cf30-6ee5-4890-888b-896940ac6656 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/78181bea-41e3-4044-b9e4-9c3700fb9037" status: 200 len: 1366 microversion: 2.1 time: 0.270091 May 23 15:48:13.414352 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 386/741] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:48:13 2022] GET /compute/v2.1/servers/78181bea-41e3-4044-b9e4-9c3700fb9037 => generated 1366 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:48:13.635756 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [req-bee5312e-7894-4863-9ddd-286786b61b89 req-e148ffb2-bde2-448b-abaf-e37f6b441d0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78181bea-41e3-4044-b9e4-9c3700fb9037", "tag": "6f5eff2d-445b-4844-b500-782ab519f384"}]} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:48:13.645507 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-bee5312e-7894-4863-9ddd-286786b61b89 req-e148ffb2-bde2-448b-abaf-e37f6b441d0b service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:13.646141 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-bee5312e-7894-4863-9ddd-286786b61b89 req-e148ffb2-bde2-448b-abaf-e37f6b441d0b service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:13.659449 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.compute.server_external_events [req-bee5312e-7894-4863-9ddd-286786b61b89 req-e148ffb2-bde2-448b-abaf-e37f6b441d0b service nova] Creating event network-changed:6f5eff2d-445b-4844-b500-782ab519f384 for instance 78181bea-41e3-4044-b9e4-9c3700fb9037 on hv-cinder-84067 May 23 15:48:13.664638 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [req-bee5312e-7894-4863-9ddd-286786b61b89 req-e148ffb2-bde2-448b-abaf-e37f6b441d0b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032740 May 23 15:48:13.669416 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 356/742] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:48:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:48:14.389563 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-3a6baf00-eded-48a9-b006-b59082f7c527 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:14.390176 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-3a6baf00-eded-48a9-b006-b59082f7c527 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: e82853b8-ba61-4e2f-a961-7778da726303] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:14.397572 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3a6baf00-eded-48a9-b006-b59082f7c527 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:14.398041 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3a6baf00-eded-48a9-b006-b59082f7c527 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:14.398843 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3a6baf00-eded-48a9-b006-b59082f7c527 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:14.399283 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3a6baf00-eded-48a9-b006-b59082f7c527 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:14.431437 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-5fc891e5-73e7-469c-b9ca-c2cebe6fca63 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:14.432918 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-5fc891e5-73e7-469c-b9ca-c2cebe6fca63 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 78181bea-41e3-4044-b9e4-9c3700fb9037] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:14.439658 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-5fc891e5-73e7-469c-b9ca-c2cebe6fca63 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:14.440116 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-5fc891e5-73e7-469c-b9ca-c2cebe6fca63 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:14.440902 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-5fc891e5-73e7-469c-b9ca-c2cebe6fca63 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:14.441443 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-5fc891e5-73e7-469c-b9ca-c2cebe6fca63 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:14.580859 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-3a6baf00-eded-48a9-b006-b59082f7c527 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:14.588436 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-3a6baf00-eded-48a9-b006-b59082f7c527 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/e82853b8-ba61-4e2f-a961-7778da726303" status: 200 len: 1267 microversion: 2.1 time: 0.202698 May 23 15:48:14.594535 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 387/743] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:48:14 2022] GET /compute/v2.1/servers/e82853b8-ba61-4e2f-a961-7778da726303 => generated 1267 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:48:14.609786 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-5fc891e5-73e7-469c-b9ca-c2cebe6fca63 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:14.617523 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-5fc891e5-73e7-469c-b9ca-c2cebe6fca63 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/78181bea-41e3-4044-b9e4-9c3700fb9037" status: 200 len: 1366 microversion: 2.1 time: 0.190816 May 23 15:48:14.618094 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 357/744] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:48:14 2022] GET /compute/v2.1/servers/78181bea-41e3-4044-b9e4-9c3700fb9037 => generated 1366 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:48:15.610074 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-48c94b37-f38e-496c-bca3-9a6936f27bd2 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:15.612118 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-48c94b37-f38e-496c-bca3-9a6936f27bd2 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: e82853b8-ba61-4e2f-a961-7778da726303] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:15.620118 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-48c94b37-f38e-496c-bca3-9a6936f27bd2 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:15.620247 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-48c94b37-f38e-496c-bca3-9a6936f27bd2 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:15.621198 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-48c94b37-f38e-496c-bca3-9a6936f27bd2 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:15.621651 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-48c94b37-f38e-496c-bca3-9a6936f27bd2 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:15.640540 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-42ce23cd-07f6-4f85-83d1-dbcc96856e23 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:15.642516 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-42ce23cd-07f6-4f85-83d1-dbcc96856e23 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 78181bea-41e3-4044-b9e4-9c3700fb9037] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:15.650298 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-42ce23cd-07f6-4f85-83d1-dbcc96856e23 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:15.651210 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-42ce23cd-07f6-4f85-83d1-dbcc96856e23 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:15.652302 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-42ce23cd-07f6-4f85-83d1-dbcc96856e23 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:15.653230 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-42ce23cd-07f6-4f85-83d1-dbcc96856e23 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:15.889374 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-48c94b37-f38e-496c-bca3-9a6936f27bd2 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:15.901628 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-42ce23cd-07f6-4f85-83d1-dbcc96856e23 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:15.902741 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-48c94b37-f38e-496c-bca3-9a6936f27bd2 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/e82853b8-ba61-4e2f-a961-7778da726303" status: 200 len: 1267 microversion: 2.1 time: 0.298729 May 23 15:48:15.903582 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 388/745] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:48:15 2022] GET /compute/v2.1/servers/e82853b8-ba61-4e2f-a961-7778da726303 => generated 1267 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:48:15.911603 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-42ce23cd-07f6-4f85-83d1-dbcc96856e23 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/78181bea-41e3-4044-b9e4-9c3700fb9037" status: 200 len: 1366 microversion: 2.1 time: 0.278423 May 23 15:48:15.912344 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 358/746] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:48:15 2022] GET /compute/v2.1/servers/78181bea-41e3-4044-b9e4-9c3700fb9037 => generated 1366 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:48:16.920267 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-b435535a-f5bf-49ea-acc1-ea4379403aa5 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:16.920653 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-b435535a-f5bf-49ea-acc1-ea4379403aa5 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: e82853b8-ba61-4e2f-a961-7778da726303] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:16.922590 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_cell0:SELECT=2 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:48:16.930532 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-b435535a-f5bf-49ea-acc1-ea4379403aa5 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:16.933160 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-b435535a-f5bf-49ea-acc1-ea4379403aa5 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:16.933160 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-b435535a-f5bf-49ea-acc1-ea4379403aa5 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:16.933160 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-b435535a-f5bf-49ea-acc1-ea4379403aa5 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:16.934165 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-cc1e78ac-a703-4b84-bc0e-a1ade66c4ab7 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:16.934781 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-cc1e78ac-a703-4b84-bc0e-a1ade66c4ab7 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 78181bea-41e3-4044-b9e4-9c3700fb9037] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:16.936800 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_cell0:SELECT=2 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:48:16.940163 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_cell0:SELECT=10 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:48:16.946057 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-cc1e78ac-a703-4b84-bc0e-a1ade66c4ab7 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:16.946509 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-cc1e78ac-a703-4b84-bc0e-a1ade66c4ab7 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:16.947284 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-cc1e78ac-a703-4b84-bc0e-a1ade66c4ab7 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:16.947780 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-cc1e78ac-a703-4b84-bc0e-a1ade66c4ab7 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:17.140535 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-b435535a-f5bf-49ea-acc1-ea4379403aa5 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:17.146013 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-cc1e78ac-a703-4b84-bc0e-a1ade66c4ab7 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:17.149596 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-b435535a-f5bf-49ea-acc1-ea4379403aa5 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/e82853b8-ba61-4e2f-a961-7778da726303" status: 200 len: 1267 microversion: 2.1 time: 0.233606 May 23 15:48:17.150163 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 389/747] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:48:16 2022] GET /compute/v2.1/servers/e82853b8-ba61-4e2f-a961-7778da726303 => generated 1267 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:48:17.157943 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-cc1e78ac-a703-4b84-bc0e-a1ade66c4ab7 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/78181bea-41e3-4044-b9e4-9c3700fb9037" status: 200 len: 1366 microversion: 2.1 time: 0.227472 May 23 15:48:17.158725 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 359/748] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:48:16 2022] GET /compute/v2.1/servers/78181bea-41e3-4044-b9e4-9c3700fb9037 => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:48:17.992063 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-5ccc2436-7690-4301-8ac0-4f0597567148 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:17.992614 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-5ccc2436-7690-4301-8ac0-4f0597567148 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:17.994491 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_cell0:SELECT=10 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:48:17.999833 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5ccc2436-7690-4301-8ac0-4f0597567148 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:18.000283 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5ccc2436-7690-4301-8ac0-4f0597567148 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:18.001043 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5ccc2436-7690-4301-8ac0-4f0597567148 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:18.001505 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5ccc2436-7690-4301-8ac0-4f0597567148 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:18.028407 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-5ccc2436-7690-4301-8ac0-4f0597567148 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3/ips" status: 200 len: 152 microversion: 2.20 time: 0.040146 May 23 15:48:18.037542 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 390/749] 10.222.0.64 () {60 vars in 1288 bytes} [Mon May 23 15:48:17 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3/ips => generated 152 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 15:48:18.166866 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-ee036d2d-ed36-4d27-955e-b5a82ebcccfc tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:18.167582 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-ee036d2d-ed36-4d27-955e-b5a82ebcccfc tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: e82853b8-ba61-4e2f-a961-7778da726303] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:18.174416 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ee036d2d-ed36-4d27-955e-b5a82ebcccfc tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:18.175040 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ee036d2d-ed36-4d27-955e-b5a82ebcccfc tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:18.175183 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-ce5a7f17-5961-41f7-aa14-01a7d236bd2e tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:18.175862 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-ce5a7f17-5961-41f7-aa14-01a7d236bd2e tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 78181bea-41e3-4044-b9e4-9c3700fb9037] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:18.176032 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ee036d2d-ed36-4d27-955e-b5a82ebcccfc tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:18.176364 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ee036d2d-ed36-4d27-955e-b5a82ebcccfc tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:18.184145 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ce5a7f17-5961-41f7-aa14-01a7d236bd2e tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:18.184529 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ce5a7f17-5961-41f7-aa14-01a7d236bd2e tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:18.185406 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ce5a7f17-5961-41f7-aa14-01a7d236bd2e tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:18.185845 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ce5a7f17-5961-41f7-aa14-01a7d236bd2e tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:18.203858 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_cell1:SELECT=100 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:48:18.403272 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-ee036d2d-ed36-4d27-955e-b5a82ebcccfc tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:18.406419 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-ce5a7f17-5961-41f7-aa14-01a7d236bd2e tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:18.414554 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-ee036d2d-ed36-4d27-955e-b5a82ebcccfc tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/e82853b8-ba61-4e2f-a961-7778da726303" status: 200 len: 1267 microversion: 2.1 time: 0.249225 May 23 15:48:18.414554 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 360/750] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:48:18 2022] GET /compute/v2.1/servers/e82853b8-ba61-4e2f-a961-7778da726303 => generated 1267 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:48:18.424418 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-ce5a7f17-5961-41f7-aa14-01a7d236bd2e tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/78181bea-41e3-4044-b9e4-9c3700fb9037" status: 200 len: 1366 microversion: 2.1 time: 0.253312 May 23 15:48:18.424996 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 391/751] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:48:18 2022] GET /compute/v2.1/servers/78181bea-41e3-4044-b9e4-9c3700fb9037 => generated 1366 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:48:19.429708 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-87fc3ea7-f110-492e-986e-3cce8df1794a tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:19.430316 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-87fc3ea7-f110-492e-986e-3cce8df1794a tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: e82853b8-ba61-4e2f-a961-7778da726303] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:19.436714 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-87fc3ea7-f110-492e-986e-3cce8df1794a tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:19.437187 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-87fc3ea7-f110-492e-986e-3cce8df1794a tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:19.437952 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-87fc3ea7-f110-492e-986e-3cce8df1794a tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:19.438381 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-87fc3ea7-f110-492e-986e-3cce8df1794a tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:19.441832 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-2215c69a-6c75-4766-964d-f2fd3087daec tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:19.442462 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-2215c69a-6c75-4766-964d-f2fd3087daec tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 78181bea-41e3-4044-b9e4-9c3700fb9037] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:19.450033 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2215c69a-6c75-4766-964d-f2fd3087daec tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:19.450498 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2215c69a-6c75-4766-964d-f2fd3087daec tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:19.451285 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2215c69a-6c75-4766-964d-f2fd3087daec tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:19.451730 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2215c69a-6c75-4766-964d-f2fd3087daec tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:19.652102 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-87fc3ea7-f110-492e-986e-3cce8df1794a tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:19.656909 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-2215c69a-6c75-4766-964d-f2fd3087daec tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:19.661605 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-87fc3ea7-f110-492e-986e-3cce8df1794a tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/e82853b8-ba61-4e2f-a961-7778da726303" status: 200 len: 1267 microversion: 2.1 time: 0.235414 May 23 15:48:19.665320 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 361/752] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:48:19 2022] GET /compute/v2.1/servers/e82853b8-ba61-4e2f-a961-7778da726303 => generated 1267 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:48:19.666919 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-2215c69a-6c75-4766-964d-f2fd3087daec tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/78181bea-41e3-4044-b9e4-9c3700fb9037" status: 200 len: 1366 microversion: 2.1 time: 0.229513 May 23 15:48:19.667486 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 392/753] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:48:19 2022] GET /compute/v2.1/servers/78181bea-41e3-4044-b9e4-9c3700fb9037 => generated 1366 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:48:19.990757 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [req-3e907aca-bfa6-4544-9065-e71d10c48759 req-cbbb393f-4640-4445-a61a-a533283e42ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78181bea-41e3-4044-b9e4-9c3700fb9037", "name": "network-vif-plugged", "status": "completed", "tag": "6f5eff2d-445b-4844-b500-782ab519f384"}]} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:48:19.998804 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-3e907aca-bfa6-4544-9065-e71d10c48759 req-cbbb393f-4640-4445-a61a-a533283e42ae service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:19.999258 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-3e907aca-bfa6-4544-9065-e71d10c48759 req-cbbb393f-4640-4445-a61a-a533283e42ae service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:20.011084 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.compute.server_external_events [req-3e907aca-bfa6-4544-9065-e71d10c48759 req-cbbb393f-4640-4445-a61a-a533283e42ae service nova] Creating event network-vif-plugged:6f5eff2d-445b-4844-b500-782ab519f384 for instance 78181bea-41e3-4044-b9e4-9c3700fb9037 on hv-cinder-84067 May 23 15:48:20.016741 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [req-3e907aca-bfa6-4544-9065-e71d10c48759 req-cbbb393f-4640-4445-a61a-a533283e42ae service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029652 May 23 15:48:20.018926 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 362/754] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:48:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:48:20.348285 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-58ddf8f4-004c-4e87-9f7f-008087b84412 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:48:20.348744 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-58ddf8f4-004c-4e87-9f7f-008087b84412 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:20.354733 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-58ddf8f4-004c-4e87-9f7f-008087b84412 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:20.356154 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-58ddf8f4-004c-4e87-9f7f-008087b84412 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:20.356154 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-58ddf8f4-004c-4e87-9f7f-008087b84412 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:20.356355 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-58ddf8f4-004c-4e87-9f7f-008087b84412 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:20.382219 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.objects.instance [None req-58ddf8f4-004c-4e87-9f7f-008087b84412 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lazy-loading 'flavor' on Instance uuid 9d9a9391-45aa-4e87-b025-839d2bf5c8a3 {{(pid=124934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 15:48:20.680310 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-9949ab5e-2e90-4635-9f26-125ec78504b0 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:20.680953 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-9949ab5e-2e90-4635-9f26-125ec78504b0 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: e82853b8-ba61-4e2f-a961-7778da726303] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:20.687056 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-9949ab5e-2e90-4635-9f26-125ec78504b0 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:20.687512 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-9949ab5e-2e90-4635-9f26-125ec78504b0 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:20.688274 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-9949ab5e-2e90-4635-9f26-125ec78504b0 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:20.688737 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-9949ab5e-2e90-4635-9f26-125ec78504b0 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:20.826112 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-9949ab5e-2e90-4635-9f26-125ec78504b0 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:20.834556 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-9949ab5e-2e90-4635-9f26-125ec78504b0 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/e82853b8-ba61-4e2f-a961-7778da726303" status: 200 len: 1267 microversion: 2.1 time: 0.158855 May 23 15:48:20.838907 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 363/755] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:48:20 2022] GET /compute/v2.1/servers/e82853b8-ba61-4e2f-a961-7778da726303 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:48:20.840016 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-876e1881-0200-47e9-b42d-8f0e072447f1 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:20.840699 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-876e1881-0200-47e9-b42d-8f0e072447f1 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 78181bea-41e3-4044-b9e4-9c3700fb9037] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:20.847455 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-876e1881-0200-47e9-b42d-8f0e072447f1 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:20.847989 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-876e1881-0200-47e9-b42d-8f0e072447f1 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:20.848894 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-876e1881-0200-47e9-b42d-8f0e072447f1 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:20.849438 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-876e1881-0200-47e9-b42d-8f0e072447f1 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:20.996768 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-876e1881-0200-47e9-b42d-8f0e072447f1 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:21.004424 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-876e1881-0200-47e9-b42d-8f0e072447f1 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/78181bea-41e3-4044-b9e4-9c3700fb9037" status: 200 len: 1366 microversion: 2.1 time: 0.168281 May 23 15:48:21.005131 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 364/756] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:48:20 2022] GET /compute/v2.1/servers/78181bea-41e3-4044-b9e4-9c3700fb9037 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:48:21.086308 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-58ddf8f4-004c-4e87-9f7f-008087b84412 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "POST /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3/action" status: 202 len: 0 microversion: 2.20 time: 0.742291 May 23 15:48:21.086919 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 393/757] 10.222.0.64 () {62 vars in 1318 bytes} [Mon May 23 15:48:20 2022] POST /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3/action => generated 0 bytes in 744 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 23 15:48:21.095740 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-4cba0dec-f6c0-4871-a8a3-148cbd9bb462 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:21.096565 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-4cba0dec-f6c0-4871-a8a3-148cbd9bb462 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:21.102503 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-4cba0dec-f6c0-4871-a8a3-148cbd9bb462 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:21.102948 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-4cba0dec-f6c0-4871-a8a3-148cbd9bb462 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:21.103707 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-4cba0dec-f6c0-4871-a8a3-148cbd9bb462 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:21.104138 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-4cba0dec-f6c0-4871-a8a3-148cbd9bb462 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:21.257213 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-4cba0dec-f6c0-4871-a8a3-148cbd9bb462 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:21.258236 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_cell1:SELECT=100 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:48:21.263135 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-4cba0dec-f6c0-4871-a8a3-148cbd9bb462 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:21.264654 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-4cba0dec-f6c0-4871-a8a3-148cbd9bb462 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:21.265851 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-4cba0dec-f6c0-4871-a8a3-148cbd9bb462 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 200 len: 1723 microversion: 2.20 time: 0.174686 May 23 15:48:21.266412 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 365/758] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:48:21 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:48:21.852397 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-eebef2f3-d0d8-42b4-9468-76696fc77dbb tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:21.853115 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-eebef2f3-d0d8-42b4-9468-76696fc77dbb tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: e82853b8-ba61-4e2f-a961-7778da726303] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:21.859372 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-eebef2f3-d0d8-42b4-9468-76696fc77dbb tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:21.859819 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-eebef2f3-d0d8-42b4-9468-76696fc77dbb tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:21.861172 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-eebef2f3-d0d8-42b4-9468-76696fc77dbb tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:21.861609 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-eebef2f3-d0d8-42b4-9468-76696fc77dbb tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:21.999262 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-eebef2f3-d0d8-42b4-9468-76696fc77dbb tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:22.007295 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-eebef2f3-d0d8-42b4-9468-76696fc77dbb tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/e82853b8-ba61-4e2f-a961-7778da726303" status: 200 len: 1267 microversion: 2.1 time: 0.159517 May 23 15:48:22.007847 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 394/759] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:48:21 2022] GET /compute/v2.1/servers/e82853b8-ba61-4e2f-a961-7778da726303 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:48:22.021555 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-7cebe236-4049-477a-869f-5b660ba9ced6 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:22.022179 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-7cebe236-4049-477a-869f-5b660ba9ced6 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 78181bea-41e3-4044-b9e4-9c3700fb9037] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:22.029188 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-7cebe236-4049-477a-869f-5b660ba9ced6 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:22.029646 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-7cebe236-4049-477a-869f-5b660ba9ced6 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:22.030415 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-7cebe236-4049-477a-869f-5b660ba9ced6 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:22.030859 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-7cebe236-4049-477a-869f-5b660ba9ced6 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:22.166452 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-7cebe236-4049-477a-869f-5b660ba9ced6 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:22.175069 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-7cebe236-4049-477a-869f-5b660ba9ced6 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/78181bea-41e3-4044-b9e4-9c3700fb9037" status: 200 len: 1557 microversion: 2.1 time: 0.157818 May 23 15:48:22.178294 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 366/760] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:48:22 2022] GET /compute/v2.1/servers/78181bea-41e3-4044-b9e4-9c3700fb9037 => generated 1557 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:48:22.191765 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-bda8e0c7-3b5b-48ba-8b4b-571bb0a21c18 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:22.192352 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-bda8e0c7-3b5b-48ba-8b4b-571bb0a21c18 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 78181bea-41e3-4044-b9e4-9c3700fb9037] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:22.198311 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-bda8e0c7-3b5b-48ba-8b4b-571bb0a21c18 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:22.198762 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-bda8e0c7-3b5b-48ba-8b4b-571bb0a21c18 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:22.199536 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-bda8e0c7-3b5b-48ba-8b4b-571bb0a21c18 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:22.199973 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-bda8e0c7-3b5b-48ba-8b4b-571bb0a21c18 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:22.287339 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-8f379e07-bf4d-4960-b369-4433e28a9be7 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:22.288543 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-8f379e07-bf4d-4960-b369-4433e28a9be7 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:22.290486 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-bda8e0c7-3b5b-48ba-8b4b-571bb0a21c18 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/78181bea-41e3-4044-b9e4-9c3700fb9037/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.102924 May 23 15:48:22.300771 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 395/761] 10.222.0.64 () {58 vars in 1274 bytes} [Mon May 23 15:48:22 2022] GET /compute/v2.1/servers/78181bea-41e3-4044-b9e4-9c3700fb9037/os-interface => generated 285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:48:22.302880 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-8f379e07-bf4d-4960-b369-4433e28a9be7 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:22.303299 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-8f379e07-bf4d-4960-b369-4433e28a9be7 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:22.304089 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-8f379e07-bf4d-4960-b369-4433e28a9be7 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:22.304524 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-8f379e07-bf4d-4960-b369-4433e28a9be7 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:22.546912 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-8f379e07-bf4d-4960-b369-4433e28a9be7 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:22.555456 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-8f379e07-bf4d-4960-b369-4433e28a9be7 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:22.556963 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-8f379e07-bf4d-4960-b369-4433e28a9be7 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:22.558151 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-8f379e07-bf4d-4960-b369-4433e28a9be7 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 200 len: 1723 microversion: 2.20 time: 0.276433 May 23 15:48:22.558721 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 367/762] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:48:22 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 1723 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 15:48:23.024901 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-a66fe03c-0da8-4aea-9f42-a47ae2422bce tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:23.025957 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-a66fe03c-0da8-4aea-9f42-a47ae2422bce tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: e82853b8-ba61-4e2f-a961-7778da726303] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:23.032027 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-a66fe03c-0da8-4aea-9f42-a47ae2422bce tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:23.032485 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-a66fe03c-0da8-4aea-9f42-a47ae2422bce tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:23.033276 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-a66fe03c-0da8-4aea-9f42-a47ae2422bce tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:23.033714 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-a66fe03c-0da8-4aea-9f42-a47ae2422bce tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:23.268332 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-a66fe03c-0da8-4aea-9f42-a47ae2422bce tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:23.275862 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-a66fe03c-0da8-4aea-9f42-a47ae2422bce tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/e82853b8-ba61-4e2f-a961-7778da726303" status: 200 len: 1267 microversion: 2.1 time: 0.255347 May 23 15:48:23.276619 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 396/763] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:48:23 2022] GET /compute/v2.1/servers/e82853b8-ba61-4e2f-a961-7778da726303 => generated 1267 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:48:23.577296 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-c0ecf2d3-9c0a-47a2-a180-102c904086ee tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:23.578079 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-c0ecf2d3-9c0a-47a2-a180-102c904086ee tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:23.585078 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c0ecf2d3-9c0a-47a2-a180-102c904086ee tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:23.592681 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c0ecf2d3-9c0a-47a2-a180-102c904086ee tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:23.592681 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c0ecf2d3-9c0a-47a2-a180-102c904086ee tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:23.592681 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c0ecf2d3-9c0a-47a2-a180-102c904086ee tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:23.786962 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [req-ed9dbcea-a13a-4317-a3d7-d95a7eaed4b9 req-99a7a96f-6e74-46d3-af0c-a9aedad33d43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78181bea-41e3-4044-b9e4-9c3700fb9037", "tag": "6f5eff2d-445b-4844-b500-782ab519f384"}]} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:48:23.799705 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-ed9dbcea-a13a-4317-a3d7-d95a7eaed4b9 req-99a7a96f-6e74-46d3-af0c-a9aedad33d43 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:23.800402 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-ed9dbcea-a13a-4317-a3d7-d95a7eaed4b9 req-99a7a96f-6e74-46d3-af0c-a9aedad33d43 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:23.813460 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-c0ecf2d3-9c0a-47a2-a180-102c904086ee tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:23.813794 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.compute.server_external_events [req-ed9dbcea-a13a-4317-a3d7-d95a7eaed4b9 req-99a7a96f-6e74-46d3-af0c-a9aedad33d43 service nova] Creating event network-changed:6f5eff2d-445b-4844-b500-782ab519f384 for instance 78181bea-41e3-4044-b9e4-9c3700fb9037 on hv-cinder-84067 May 23 15:48:23.818853 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [req-ed9dbcea-a13a-4317-a3d7-d95a7eaed4b9 req-99a7a96f-6e74-46d3-af0c-a9aedad33d43 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037045 May 23 15:48:23.819440 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 397/764] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:48:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:48:23.825767 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-c0ecf2d3-9c0a-47a2-a180-102c904086ee tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:23.827317 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-c0ecf2d3-9c0a-47a2-a180-102c904086ee tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:23.828542 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-c0ecf2d3-9c0a-47a2-a180-102c904086ee tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 200 len: 1723 microversion: 2.20 time: 0.255778 May 23 15:48:23.829120 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 368/765] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:48:23 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 1723 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:48:24.050266 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [req-b72d3a84-cd97-460b-ad93-2bd337554cdc req-4ba40bd5-b637-49d6-ac9c-07c5058fd4f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e82853b8-ba61-4e2f-a961-7778da726303", "name": "network-vif-plugged", "status": "completed", "tag": "557925ff-a601-4157-8dce-7678d594e516"}]} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:48:24.058695 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-b72d3a84-cd97-460b-ad93-2bd337554cdc req-4ba40bd5-b637-49d6-ac9c-07c5058fd4f2 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:24.062255 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-b72d3a84-cd97-460b-ad93-2bd337554cdc req-4ba40bd5-b637-49d6-ac9c-07c5058fd4f2 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:24.071138 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.compute.server_external_events [req-b72d3a84-cd97-460b-ad93-2bd337554cdc req-4ba40bd5-b637-49d6-ac9c-07c5058fd4f2 service nova] Creating event network-vif-plugged:557925ff-a601-4157-8dce-7678d594e516 for instance e82853b8-ba61-4e2f-a961-7778da726303 on hv-cinder-84067 May 23 15:48:24.077218 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [req-b72d3a84-cd97-460b-ad93-2bd337554cdc req-4ba40bd5-b637-49d6-ac9c-07c5058fd4f2 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032235 May 23 15:48:24.078487 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 398/766] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:48:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:48:24.293521 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-919e7e84-989d-48e1-b4b4-46845a5e9eba tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:24.297286 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-919e7e84-989d-48e1-b4b4-46845a5e9eba tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: e82853b8-ba61-4e2f-a961-7778da726303] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:24.301428 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-919e7e84-989d-48e1-b4b4-46845a5e9eba tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:24.302188 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-919e7e84-989d-48e1-b4b4-46845a5e9eba tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:24.303214 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-919e7e84-989d-48e1-b4b4-46845a5e9eba tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:24.303730 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-919e7e84-989d-48e1-b4b4-46845a5e9eba tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:24.530935 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-919e7e84-989d-48e1-b4b4-46845a5e9eba tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:24.541129 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-919e7e84-989d-48e1-b4b4-46845a5e9eba tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/e82853b8-ba61-4e2f-a961-7778da726303" status: 200 len: 1267 microversion: 2.1 time: 0.251415 May 23 15:48:24.542301 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 369/767] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:48:24 2022] GET /compute/v2.1/servers/e82853b8-ba61-4e2f-a961-7778da726303 => generated 1267 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:48:24.849778 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-a43d0101-3083-4974-a474-3196236bce06 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:24.850823 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-a43d0101-3083-4974-a474-3196236bce06 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:24.857938 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-a43d0101-3083-4974-a474-3196236bce06 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:24.858510 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-a43d0101-3083-4974-a474-3196236bce06 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:24.859341 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-a43d0101-3083-4974-a474-3196236bce06 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:24.859877 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-a43d0101-3083-4974-a474-3196236bce06 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:25.001622 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-a43d0101-3083-4974-a474-3196236bce06 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:25.009437 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-a43d0101-3083-4974-a474-3196236bce06 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:25.010868 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-a43d0101-3083-4974-a474-3196236bce06 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:25.012033 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-a43d0101-3083-4974-a474-3196236bce06 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 200 len: 1723 microversion: 2.20 time: 0.167919 May 23 15:48:25.012585 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 399/768] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:48:24 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:48:25.558856 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-1e2c4bfe-6f39-4f2f-9080-82fe41ee35ff tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:25.562909 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-1e2c4bfe-6f39-4f2f-9080-82fe41ee35ff tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: e82853b8-ba61-4e2f-a961-7778da726303] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:25.567117 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1e2c4bfe-6f39-4f2f-9080-82fe41ee35ff tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:25.567573 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1e2c4bfe-6f39-4f2f-9080-82fe41ee35ff tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:25.568993 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1e2c4bfe-6f39-4f2f-9080-82fe41ee35ff tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:25.569762 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1e2c4bfe-6f39-4f2f-9080-82fe41ee35ff tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:25.723916 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-1e2c4bfe-6f39-4f2f-9080-82fe41ee35ff tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:25.731369 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-1e2c4bfe-6f39-4f2f-9080-82fe41ee35ff tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/e82853b8-ba61-4e2f-a961-7778da726303" status: 200 len: 1267 microversion: 2.1 time: 0.176480 May 23 15:48:25.732036 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 370/769] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:48:25 2022] GET /compute/v2.1/servers/e82853b8-ba61-4e2f-a961-7778da726303 => generated 1267 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:48:26.030457 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-05eba75c-5d26-4026-b758-12c2cf57a433 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:26.031078 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-05eba75c-5d26-4026-b758-12c2cf57a433 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:26.038175 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-05eba75c-5d26-4026-b758-12c2cf57a433 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:26.038630 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-05eba75c-5d26-4026-b758-12c2cf57a433 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:26.045670 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-05eba75c-5d26-4026-b758-12c2cf57a433 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:26.045670 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-05eba75c-5d26-4026-b758-12c2cf57a433 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:26.171487 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-05eba75c-5d26-4026-b758-12c2cf57a433 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:26.180815 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-05eba75c-5d26-4026-b758-12c2cf57a433 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:26.182422 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-05eba75c-5d26-4026-b758-12c2cf57a433 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:26.183572 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-05eba75c-5d26-4026-b758-12c2cf57a433 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 200 len: 1723 microversion: 2.20 time: 0.156958 May 23 15:48:26.184177 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 400/770] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:48:26 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 15:48:26.747679 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-40e5c05c-db07-4154-b983-003511f3fa6c tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:26.748926 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-40e5c05c-db07-4154-b983-003511f3fa6c tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: e82853b8-ba61-4e2f-a961-7778da726303] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:26.756398 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-40e5c05c-db07-4154-b983-003511f3fa6c tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:26.757789 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-40e5c05c-db07-4154-b983-003511f3fa6c tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:26.757789 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-40e5c05c-db07-4154-b983-003511f3fa6c tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:26.758140 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-40e5c05c-db07-4154-b983-003511f3fa6c tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:26.920467 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-40e5c05c-db07-4154-b983-003511f3fa6c tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:26.928229 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-40e5c05c-db07-4154-b983-003511f3fa6c tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/e82853b8-ba61-4e2f-a961-7778da726303" status: 200 len: 1455 microversion: 2.1 time: 0.184463 May 23 15:48:26.928983 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 371/771] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:48:26 2022] GET /compute/v2.1/servers/e82853b8-ba61-4e2f-a961-7778da726303 => generated 1455 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:48:26.945032 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-60676ff1-6833-4195-9ca1-9588c4ef879d tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:26.945684 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-60676ff1-6833-4195-9ca1-9588c4ef879d tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: e82853b8-ba61-4e2f-a961-7778da726303] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:26.951937 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-60676ff1-6833-4195-9ca1-9588c4ef879d tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:26.952392 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-60676ff1-6833-4195-9ca1-9588c4ef879d tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:26.953180 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-60676ff1-6833-4195-9ca1-9588c4ef879d tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:26.953622 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-60676ff1-6833-4195-9ca1-9588c4ef879d tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:27.093797 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-60676ff1-6833-4195-9ca1-9588c4ef879d tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:27.101385 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-60676ff1-6833-4195-9ca1-9588c4ef879d tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/e82853b8-ba61-4e2f-a961-7778da726303" status: 200 len: 1455 microversion: 2.1 time: 0.160527 May 23 15:48:27.101942 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 401/772] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:48:26 2022] GET /compute/v2.1/servers/e82853b8-ba61-4e2f-a961-7778da726303 => generated 1455 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:48:27.201577 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-a6536b07-fb94-4bb1-a8c6-3c4a84eb5896 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:27.202188 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-a6536b07-fb94-4bb1-a8c6-3c4a84eb5896 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:27.208438 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a6536b07-fb94-4bb1-a8c6-3c4a84eb5896 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:27.208933 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a6536b07-fb94-4bb1-a8c6-3c4a84eb5896 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:27.209750 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a6536b07-fb94-4bb1-a8c6-3c4a84eb5896 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:27.210194 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a6536b07-fb94-4bb1-a8c6-3c4a84eb5896 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:27.347521 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-a6536b07-fb94-4bb1-a8c6-3c4a84eb5896 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:27.355557 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-a6536b07-fb94-4bb1-a8c6-3c4a84eb5896 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:27.357085 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-a6536b07-fb94-4bb1-a8c6-3c4a84eb5896 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:27.358241 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-a6536b07-fb94-4bb1-a8c6-3c4a84eb5896 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 200 len: 1723 microversion: 2.20 time: 0.160536 May 23 15:48:27.369487 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 372/773] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:48:27 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:48:28.377873 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-9b6941e6-d610-4059-9a0f-105a47bc0d4f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:28.378561 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-9b6941e6-d610-4059-9a0f-105a47bc0d4f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:28.385569 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-9b6941e6-d610-4059-9a0f-105a47bc0d4f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:28.386263 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-9b6941e6-d610-4059-9a0f-105a47bc0d4f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:28.387245 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-9b6941e6-d610-4059-9a0f-105a47bc0d4f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:28.387855 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-9b6941e6-d610-4059-9a0f-105a47bc0d4f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:28.530663 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-9b6941e6-d610-4059-9a0f-105a47bc0d4f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:28.538840 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-9b6941e6-d610-4059-9a0f-105a47bc0d4f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:28.540477 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-9b6941e6-d610-4059-9a0f-105a47bc0d4f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:28.541714 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-9b6941e6-d610-4059-9a0f-105a47bc0d4f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 200 len: 1723 microversion: 2.20 time: 0.168682 May 23 15:48:28.542266 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 402/774] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:48:28 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:48:29.191817 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [req-e15fb67f-5d0a-4272-bf2a-628d91fdbb8b req-ff7d61a5-97a6-4142-ba53-70096419c0c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e82853b8-ba61-4e2f-a961-7778da726303", "tag": "557925ff-a601-4157-8dce-7678d594e516"}]} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:48:29.200704 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-e15fb67f-5d0a-4272-bf2a-628d91fdbb8b req-ff7d61a5-97a6-4142-ba53-70096419c0c2 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:29.201177 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-e15fb67f-5d0a-4272-bf2a-628d91fdbb8b req-ff7d61a5-97a6-4142-ba53-70096419c0c2 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:29.212295 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.compute.server_external_events [req-e15fb67f-5d0a-4272-bf2a-628d91fdbb8b req-ff7d61a5-97a6-4142-ba53-70096419c0c2 service nova] Creating event network-changed:557925ff-a601-4157-8dce-7678d594e516 for instance e82853b8-ba61-4e2f-a961-7778da726303 on hv-cinder-84067 May 23 15:48:29.219003 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [req-e15fb67f-5d0a-4272-bf2a-628d91fdbb8b req-ff7d61a5-97a6-4142-ba53-70096419c0c2 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030896 May 23 15:48:29.219581 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 373/775] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:48:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:48:29.563700 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-aba32dd1-445e-4896-b430-d99168589a04 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:29.563700 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-aba32dd1-445e-4896-b430-d99168589a04 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:29.571143 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-aba32dd1-445e-4896-b430-d99168589a04 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:29.571822 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-aba32dd1-445e-4896-b430-d99168589a04 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:29.572795 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-aba32dd1-445e-4896-b430-d99168589a04 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:29.573477 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-aba32dd1-445e-4896-b430-d99168589a04 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:29.783373 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-aba32dd1-445e-4896-b430-d99168589a04 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:29.791635 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-aba32dd1-445e-4896-b430-d99168589a04 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:29.793292 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-aba32dd1-445e-4896-b430-d99168589a04 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:29.794461 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-aba32dd1-445e-4896-b430-d99168589a04 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 200 len: 1723 microversion: 2.20 time: 0.236791 May 23 15:48:29.795015 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 403/776] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:48:29 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 1723 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:48:30.813396 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-49fbc529-56bc-4bef-ad7b-c1e63f2fde04 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:30.814339 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-49fbc529-56bc-4bef-ad7b-c1e63f2fde04 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:30.820925 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-49fbc529-56bc-4bef-ad7b-c1e63f2fde04 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:30.821408 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-49fbc529-56bc-4bef-ad7b-c1e63f2fde04 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:30.822169 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-49fbc529-56bc-4bef-ad7b-c1e63f2fde04 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:30.822602 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-49fbc529-56bc-4bef-ad7b-c1e63f2fde04 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:30.959291 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-49fbc529-56bc-4bef-ad7b-c1e63f2fde04 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:30.967689 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-49fbc529-56bc-4bef-ad7b-c1e63f2fde04 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:30.969231 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-49fbc529-56bc-4bef-ad7b-c1e63f2fde04 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:30.971324 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-49fbc529-56bc-4bef-ad7b-c1e63f2fde04 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 200 len: 1723 microversion: 2.20 time: 0.161969 May 23 15:48:30.972124 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 374/777] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:48:30 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:48:31.990428 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-ebcb5f6e-14a7-424c-bf6c-64603c5bd4c3 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:31.991035 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-ebcb5f6e-14a7-424c-bf6c-64603c5bd4c3 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:31.997497 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ebcb5f6e-14a7-424c-bf6c-64603c5bd4c3 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:31.997984 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ebcb5f6e-14a7-424c-bf6c-64603c5bd4c3 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:31.998797 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ebcb5f6e-14a7-424c-bf6c-64603c5bd4c3 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:31.999259 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ebcb5f6e-14a7-424c-bf6c-64603c5bd4c3 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:32.133501 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-ebcb5f6e-14a7-424c-bf6c-64603c5bd4c3 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:32.142018 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-ebcb5f6e-14a7-424c-bf6c-64603c5bd4c3 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:32.143613 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-ebcb5f6e-14a7-424c-bf6c-64603c5bd4c3 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:32.144858 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-ebcb5f6e-14a7-424c-bf6c-64603c5bd4c3 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 200 len: 1723 microversion: 2.20 time: 0.158283 May 23 15:48:32.145579 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 404/778] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:48:31 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:48:33.163341 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-207aa3a7-1629-418a-9880-0242913fbb3c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:33.163934 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-207aa3a7-1629-418a-9880-0242913fbb3c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:33.170616 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-207aa3a7-1629-418a-9880-0242913fbb3c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:33.171078 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-207aa3a7-1629-418a-9880-0242913fbb3c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:33.171852 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-207aa3a7-1629-418a-9880-0242913fbb3c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:33.172300 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-207aa3a7-1629-418a-9880-0242913fbb3c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:33.304312 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-207aa3a7-1629-418a-9880-0242913fbb3c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:33.312742 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-207aa3a7-1629-418a-9880-0242913fbb3c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:33.315034 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-207aa3a7-1629-418a-9880-0242913fbb3c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:33.316442 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-207aa3a7-1629-418a-9880-0242913fbb3c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 200 len: 1744 microversion: 2.20 time: 0.157092 May 23 15:48:33.316994 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 375/779] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:48:33 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:48:34.336723 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-e39698c1-37fd-45fe-b8b6-c38dd22ec03c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:34.337998 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-e39698c1-37fd-45fe-b8b6-c38dd22ec03c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:34.348388 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e39698c1-37fd-45fe-b8b6-c38dd22ec03c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:34.349085 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e39698c1-37fd-45fe-b8b6-c38dd22ec03c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:34.351803 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e39698c1-37fd-45fe-b8b6-c38dd22ec03c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:34.351803 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e39698c1-37fd-45fe-b8b6-c38dd22ec03c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:34.487385 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-e39698c1-37fd-45fe-b8b6-c38dd22ec03c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:34.495683 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-e39698c1-37fd-45fe-b8b6-c38dd22ec03c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:34.497296 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-e39698c1-37fd-45fe-b8b6-c38dd22ec03c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:34.498454 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-e39698c1-37fd-45fe-b8b6-c38dd22ec03c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 200 len: 1739 microversion: 2.20 time: 0.167355 May 23 15:48:34.499008 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 405/780] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:48:34 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 1739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:48:35.520269 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-6a5c34a8-9528-4882-b83a-08a78edf5cf2 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:35.520881 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-6a5c34a8-9528-4882-b83a-08a78edf5cf2 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:35.535583 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-6a5c34a8-9528-4882-b83a-08a78edf5cf2 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:35.536306 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-6a5c34a8-9528-4882-b83a-08a78edf5cf2 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:35.537501 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-6a5c34a8-9528-4882-b83a-08a78edf5cf2 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:35.538100 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-6a5c34a8-9528-4882-b83a-08a78edf5cf2 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:35.725456 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-6a5c34a8-9528-4882-b83a-08a78edf5cf2 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:35.765454 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-6a5c34a8-9528-4882-b83a-08a78edf5cf2 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:35.765454 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-6a5c34a8-9528-4882-b83a-08a78edf5cf2 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:35.765454 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-6a5c34a8-9528-4882-b83a-08a78edf5cf2 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 200 len: 1739 microversion: 2.20 time: 0.226600 May 23 15:48:35.766199 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 376/781] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:48:35 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 1739 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 15:48:35.971668 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [req-5feb08f4-e99d-4dc7-889e-adcf30bb439f req-d39d3fc6-27ea-4e66-bd0d-01229001e7e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d9a9391-45aa-4e87-b025-839d2bf5c8a3", "name": "network-vif-plugged", "status": "completed", "tag": "9f19c00b-8184-4f9a-bd54-44e27e1f300a"}]} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:48:35.971668 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-5feb08f4-e99d-4dc7-889e-adcf30bb439f req-d39d3fc6-27ea-4e66-bd0d-01229001e7e8 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:35.971668 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-5feb08f4-e99d-4dc7-889e-adcf30bb439f req-d39d3fc6-27ea-4e66-bd0d-01229001e7e8 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:35.978638 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.compute.server_external_events [req-5feb08f4-e99d-4dc7-889e-adcf30bb439f req-d39d3fc6-27ea-4e66-bd0d-01229001e7e8 service nova] Creating event network-vif-plugged:9f19c00b-8184-4f9a-bd54-44e27e1f300a for instance 9d9a9391-45aa-4e87-b025-839d2bf5c8a3 on hv-cinder-84067 May 23 15:48:35.984436 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [req-5feb08f4-e99d-4dc7-889e-adcf30bb439f req-d39d3fc6-27ea-4e66-bd0d-01229001e7e8 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036019 May 23 15:48:35.986257 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 406/782] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:48:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:48:36.765236 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-afd0f9d7-9099-4399-8820-59fcc0748b28 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:36.766034 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-afd0f9d7-9099-4399-8820-59fcc0748b28 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:36.778596 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-afd0f9d7-9099-4399-8820-59fcc0748b28 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:36.783050 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-afd0f9d7-9099-4399-8820-59fcc0748b28 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:36.784188 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-afd0f9d7-9099-4399-8820-59fcc0748b28 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:36.785220 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-afd0f9d7-9099-4399-8820-59fcc0748b28 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:36.954861 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-afd0f9d7-9099-4399-8820-59fcc0748b28 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:36.967515 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-afd0f9d7-9099-4399-8820-59fcc0748b28 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:36.969415 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-afd0f9d7-9099-4399-8820-59fcc0748b28 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:36.971836 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-afd0f9d7-9099-4399-8820-59fcc0748b28 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 200 len: 1739 microversion: 2.20 time: 0.210448 May 23 15:48:36.972471 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 377/783] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:48:36 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 1739 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:48:37.990795 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-adef0649-fdbd-4b55-8391-a227fc0082c3 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:37.991430 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-adef0649-fdbd-4b55-8391-a227fc0082c3 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:37.998242 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-adef0649-fdbd-4b55-8391-a227fc0082c3 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:37.998692 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-adef0649-fdbd-4b55-8391-a227fc0082c3 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:37.999463 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-adef0649-fdbd-4b55-8391-a227fc0082c3 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:37.999901 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-adef0649-fdbd-4b55-8391-a227fc0082c3 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:38.136048 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-adef0649-fdbd-4b55-8391-a227fc0082c3 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:38.144054 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-adef0649-fdbd-4b55-8391-a227fc0082c3 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:38.145619 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-adef0649-fdbd-4b55-8391-a227fc0082c3 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:38.147637 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-adef0649-fdbd-4b55-8391-a227fc0082c3 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 200 len: 1739 microversion: 2.20 time: 0.160482 May 23 15:48:38.147637 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 407/784] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:48:37 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 1739 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 15:48:39.166070 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-abd82a71-dfb6-47d6-b6f8-6aae90b57fb3 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:39.167379 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-abd82a71-dfb6-47d6-b6f8-6aae90b57fb3 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:39.175500 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-abd82a71-dfb6-47d6-b6f8-6aae90b57fb3 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:39.175950 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-abd82a71-dfb6-47d6-b6f8-6aae90b57fb3 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:39.176745 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-abd82a71-dfb6-47d6-b6f8-6aae90b57fb3 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:39.177208 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-abd82a71-dfb6-47d6-b6f8-6aae90b57fb3 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:39.368850 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-abd82a71-dfb6-47d6-b6f8-6aae90b57fb3 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:39.380169 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-abd82a71-dfb6-47d6-b6f8-6aae90b57fb3 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:39.382763 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-abd82a71-dfb6-47d6-b6f8-6aae90b57fb3 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:39.384020 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-abd82a71-dfb6-47d6-b6f8-6aae90b57fb3 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 200 len: 1739 microversion: 2.20 time: 0.222039 May 23 15:48:39.385199 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 378/785] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:48:39 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 1739 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:48:40.403946 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-b6499a41-6554-4528-ae0c-fda1d95ab898 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:40.415352 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-b6499a41-6554-4528-ae0c-fda1d95ab898 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:40.434238 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_api:SELECT=58 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:48:40.436309 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-b6499a41-6554-4528-ae0c-fda1d95ab898 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:40.436771 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-b6499a41-6554-4528-ae0c-fda1d95ab898 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:40.441686 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-b6499a41-6554-4528-ae0c-fda1d95ab898 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:40.442141 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-b6499a41-6554-4528-ae0c-fda1d95ab898 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:40.463516 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:48:40.615958 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-b6499a41-6554-4528-ae0c-fda1d95ab898 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:40.624257 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-b6499a41-6554-4528-ae0c-fda1d95ab898 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:40.626074 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-b6499a41-6554-4528-ae0c-fda1d95ab898 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:40.627279 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-b6499a41-6554-4528-ae0c-fda1d95ab898 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 200 len: 1739 microversion: 2.20 time: 0.227346 May 23 15:48:40.638014 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 408/786] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:48:40 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 1739 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:48:41.648508 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-d11755f4-fe46-4d90-8eeb-dcd3f1c17dd8 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:41.649994 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-d11755f4-fe46-4d90-8eeb-dcd3f1c17dd8 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:41.657630 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-d11755f4-fe46-4d90-8eeb-dcd3f1c17dd8 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:41.658096 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-d11755f4-fe46-4d90-8eeb-dcd3f1c17dd8 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:41.658892 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-d11755f4-fe46-4d90-8eeb-dcd3f1c17dd8 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:41.659357 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-d11755f4-fe46-4d90-8eeb-dcd3f1c17dd8 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:41.810731 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-d11755f4-fe46-4d90-8eeb-dcd3f1c17dd8 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:41.820408 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-d11755f4-fe46-4d90-8eeb-dcd3f1c17dd8 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:41.822102 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-d11755f4-fe46-4d90-8eeb-dcd3f1c17dd8 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:41.823706 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-d11755f4-fe46-4d90-8eeb-dcd3f1c17dd8 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 200 len: 1739 microversion: 2.20 time: 0.182252 May 23 15:48:41.824803 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 379/787] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:48:41 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 1739 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:48:42.842430 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-a18be8f9-0fa9-420a-af7c-5071f88b99c5 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:42.843022 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-a18be8f9-0fa9-420a-af7c-5071f88b99c5 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:42.855926 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-a18be8f9-0fa9-420a-af7c-5071f88b99c5 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:42.856391 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-a18be8f9-0fa9-420a-af7c-5071f88b99c5 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:42.857219 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-a18be8f9-0fa9-420a-af7c-5071f88b99c5 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:42.857676 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-a18be8f9-0fa9-420a-af7c-5071f88b99c5 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:43.017244 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-a18be8f9-0fa9-420a-af7c-5071f88b99c5 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:43.026452 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-a18be8f9-0fa9-420a-af7c-5071f88b99c5 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:43.028247 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-a18be8f9-0fa9-420a-af7c-5071f88b99c5 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:43.029508 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-a18be8f9-0fa9-420a-af7c-5071f88b99c5 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 200 len: 1739 microversion: 2.20 time: 0.190913 May 23 15:48:43.032772 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 409/788] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:48:42 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 1739 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:48:44.049955 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-e4433774-f244-4295-a46b-abf68ca64ee5 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:44.050916 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-e4433774-f244-4295-a46b-abf68ca64ee5 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:44.053584 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_api:SELECT=56 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:48:44.058848 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e4433774-f244-4295-a46b-abf68ca64ee5 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:44.059301 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e4433774-f244-4295-a46b-abf68ca64ee5 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:44.060164 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e4433774-f244-4295-a46b-abf68ca64ee5 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:44.060639 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e4433774-f244-4295-a46b-abf68ca64ee5 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:44.219320 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-e4433774-f244-4295-a46b-abf68ca64ee5 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:44.230584 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-e4433774-f244-4295-a46b-abf68ca64ee5 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:44.232692 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-e4433774-f244-4295-a46b-abf68ca64ee5 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:44.233887 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-e4433774-f244-4295-a46b-abf68ca64ee5 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 200 len: 1739 microversion: 2.20 time: 0.188523 May 23 15:48:44.234444 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 380/789] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:48:44 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 1739 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:48:45.252814 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-18372158-6d39-45a6-99a3-d40b2a5d3d40 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:45.254304 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-18372158-6d39-45a6-99a3-d40b2a5d3d40 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:45.264564 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-18372158-6d39-45a6-99a3-d40b2a5d3d40 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:45.266259 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-18372158-6d39-45a6-99a3-d40b2a5d3d40 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:45.267153 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-18372158-6d39-45a6-99a3-d40b2a5d3d40 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:45.268738 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-18372158-6d39-45a6-99a3-d40b2a5d3d40 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:45.298427 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-a5a21125-63e9-4772-b068-66b8bacf7275 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:45.301421 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-a5a21125-63e9-4772-b068-66b8bacf7275 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] [instance: dd66096c-0b64-4a26-bdec-1b1a46310cfb] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:45.315059 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a5a21125-63e9-4772-b068-66b8bacf7275 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:45.317950 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a5a21125-63e9-4772-b068-66b8bacf7275 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:45.318974 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a5a21125-63e9-4772-b068-66b8bacf7275 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:45.320091 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a5a21125-63e9-4772-b068-66b8bacf7275 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:45.381650 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-a5a21125-63e9-4772-b068-66b8bacf7275 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] [instance: dd66096c-0b64-4a26-bdec-1b1a46310cfb] Going to try to terminate instance {{(pid=124933) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 15:48:45.521800 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-18372158-6d39-45a6-99a3-d40b2a5d3d40 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:45.532510 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-18372158-6d39-45a6-99a3-d40b2a5d3d40 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:45.534095 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:48:45.537019 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-18372158-6d39-45a6-99a3-d40b2a5d3d40 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:45.538487 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-18372158-6d39-45a6-99a3-d40b2a5d3d40 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 200 len: 1739 microversion: 2.20 time: 0.289882 May 23 15:48:45.553681 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 410/790] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:48:45 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 1739 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:48:45.560581 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [req-52aa135f-8434-4c0b-af2d-08abbed44e5e req-d77a8385-ddf7-4168-a72c-e1902f5e0dc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd66096c-0b64-4a26-bdec-1b1a46310cfb", "tag": "a0610243-2466-4315-a3e6-15f6cea816b8"}]} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:48:45.572080 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-52aa135f-8434-4c0b-af2d-08abbed44e5e req-d77a8385-ddf7-4168-a72c-e1902f5e0dc8 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:45.573416 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-52aa135f-8434-4c0b-af2d-08abbed44e5e req-d77a8385-ddf7-4168-a72c-e1902f5e0dc8 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:45.587787 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.compute.server_external_events [req-52aa135f-8434-4c0b-af2d-08abbed44e5e req-d77a8385-ddf7-4168-a72c-e1902f5e0dc8 service nova] Creating event network-changed:a0610243-2466-4315-a3e6-15f6cea816b8 for instance dd66096c-0b64-4a26-bdec-1b1a46310cfb on hv-cinder-84067 May 23 15:48:45.592763 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [req-52aa135f-8434-4c0b-af2d-08abbed44e5e req-d77a8385-ddf7-4168-a72c-e1902f5e0dc8 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037565 May 23 15:48:45.598106 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 411/791] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:48:45.783466 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-a5a21125-63e9-4772-b068-66b8bacf7275 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] 10.222.0.64 "DELETE /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb" status: 204 len: 0 microversion: 2.1 time: 0.489178 May 23 15:48:45.794450 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 381/792] 10.222.0.64 () {58 vars in 1238 bytes} [Mon May 23 15:48:45 2022] DELETE /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb => generated 0 bytes in 491 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 23 15:48:45.796882 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-1019d439-fd65-4be0-8716-ea07b4ce28b7 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:45.797795 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-1019d439-fd65-4be0-8716-ea07b4ce28b7 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] [instance: dd66096c-0b64-4a26-bdec-1b1a46310cfb] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:45.808162 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-1019d439-fd65-4be0-8716-ea07b4ce28b7 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:45.808961 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-1019d439-fd65-4be0-8716-ea07b4ce28b7 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:45.809998 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-1019d439-fd65-4be0-8716-ea07b4ce28b7 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:45.810605 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-1019d439-fd65-4be0-8716-ea07b4ce28b7 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:46.011696 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-1019d439-fd65-4be0-8716-ea07b4ce28b7 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b983c0a2a124ac3aa3403e0777612f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0860b3d072246d49cd43a900351d571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:46.021018 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-1019d439-fd65-4be0-8716-ea07b4ce28b7 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] 10.222.0.64 "GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb" status: 200 len: 1567 microversion: 2.1 time: 0.228850 May 23 15:48:46.023552 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 412/793] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:48:45 2022] GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb => generated 1567 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:48:46.560218 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-2b4695e9-03eb-4501-95b7-d14aab66bde5 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:46.561137 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-2b4695e9-03eb-4501-95b7-d14aab66bde5 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:46.569215 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-2b4695e9-03eb-4501-95b7-d14aab66bde5 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:46.569877 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-2b4695e9-03eb-4501-95b7-d14aab66bde5 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:46.570832 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-2b4695e9-03eb-4501-95b7-d14aab66bde5 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:46.571281 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-2b4695e9-03eb-4501-95b7-d14aab66bde5 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:46.708191 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-2b4695e9-03eb-4501-95b7-d14aab66bde5 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:46.716407 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-2b4695e9-03eb-4501-95b7-d14aab66bde5 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:46.718025 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-2b4695e9-03eb-4501-95b7-d14aab66bde5 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:46.719189 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-2b4695e9-03eb-4501-95b7-d14aab66bde5 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 200 len: 1739 microversion: 2.20 time: 0.164649 May 23 15:48:46.719748 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 382/794] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:48:46 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 1739 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:48:47.039212 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-b461a00b-1700-4ff2-9cc7-98d0392e3d33 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:47.039823 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-b461a00b-1700-4ff2-9cc7-98d0392e3d33 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] [instance: dd66096c-0b64-4a26-bdec-1b1a46310cfb] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:47.046299 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-b461a00b-1700-4ff2-9cc7-98d0392e3d33 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:47.046746 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-b461a00b-1700-4ff2-9cc7-98d0392e3d33 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:47.047503 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-b461a00b-1700-4ff2-9cc7-98d0392e3d33 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:47.047936 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-b461a00b-1700-4ff2-9cc7-98d0392e3d33 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:47.176301 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-b461a00b-1700-4ff2-9cc7-98d0392e3d33 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b983c0a2a124ac3aa3403e0777612f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0860b3d072246d49cd43a900351d571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:47.183726 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-b461a00b-1700-4ff2-9cc7-98d0392e3d33 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] 10.222.0.64 "GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb" status: 200 len: 1567 microversion: 2.1 time: 0.149085 May 23 15:48:47.184274 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 413/795] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:48:47 2022] GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:48:47.737304 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-495d5753-20fb-4820-87e5-56927b4e96cb tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:47.741955 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-495d5753-20fb-4820-87e5-56927b4e96cb tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:47.745411 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-495d5753-20fb-4820-87e5-56927b4e96cb tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:47.745885 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-495d5753-20fb-4820-87e5-56927b4e96cb tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:47.746655 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-495d5753-20fb-4820-87e5-56927b4e96cb tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:47.747096 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-495d5753-20fb-4820-87e5-56927b4e96cb tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:47.880360 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-495d5753-20fb-4820-87e5-56927b4e96cb tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:47.888381 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-495d5753-20fb-4820-87e5-56927b4e96cb tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:47.889912 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-495d5753-20fb-4820-87e5-56927b4e96cb tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:47.891077 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-495d5753-20fb-4820-87e5-56927b4e96cb tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 200 len: 1739 microversion: 2.20 time: 0.157763 May 23 15:48:47.891638 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 383/796] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:48:47 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 1739 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:48:48.202371 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-20a6c453-6162-489d-bb7c-0f587e9f7d40 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:48.203004 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-20a6c453-6162-489d-bb7c-0f587e9f7d40 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] [instance: dd66096c-0b64-4a26-bdec-1b1a46310cfb] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:48.211141 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-20a6c453-6162-489d-bb7c-0f587e9f7d40 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:48.211595 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-20a6c453-6162-489d-bb7c-0f587e9f7d40 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:48.212369 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-20a6c453-6162-489d-bb7c-0f587e9f7d40 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:48.212845 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-20a6c453-6162-489d-bb7c-0f587e9f7d40 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:48.551062 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-20a6c453-6162-489d-bb7c-0f587e9f7d40 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b983c0a2a124ac3aa3403e0777612f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0860b3d072246d49cd43a900351d571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:48.560090 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-20a6c453-6162-489d-bb7c-0f587e9f7d40 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] 10.222.0.64 "GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb" status: 200 len: 1567 microversion: 2.1 time: 0.361601 May 23 15:48:48.561560 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 414/797] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:48:48 2022] GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb => generated 1567 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:48:48.913256 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-275db491-2fe2-4662-9cd6-60ba9af68ec2 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:48.913970 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-275db491-2fe2-4662-9cd6-60ba9af68ec2 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:48.923054 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [req-b7f1b978-0430-4aa3-8b32-2abf4f3a2d46 req-e71afcff-9d1d-4f37-b13c-afb184aa4708 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd66096c-0b64-4a26-bdec-1b1a46310cfb", "name": "network-vif-deleted", "tag": "a0610243-2466-4315-a3e6-15f6cea816b8"}]} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:48:48.924062 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-275db491-2fe2-4662-9cd6-60ba9af68ec2 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:48.926077 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-275db491-2fe2-4662-9cd6-60ba9af68ec2 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:48.927115 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-275db491-2fe2-4662-9cd6-60ba9af68ec2 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:48.927557 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-275db491-2fe2-4662-9cd6-60ba9af68ec2 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:48.932843 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-b7f1b978-0430-4aa3-8b32-2abf4f3a2d46 req-e71afcff-9d1d-4f37-b13c-afb184aa4708 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:48.933328 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-b7f1b978-0430-4aa3-8b32-2abf4f3a2d46 req-e71afcff-9d1d-4f37-b13c-afb184aa4708 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:48.946194 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.compute.server_external_events [req-b7f1b978-0430-4aa3-8b32-2abf4f3a2d46 req-e71afcff-9d1d-4f37-b13c-afb184aa4708 service nova] Creating event network-vif-deleted:a0610243-2466-4315-a3e6-15f6cea816b8 for instance dd66096c-0b64-4a26-bdec-1b1a46310cfb on hv-cinder-84067 May 23 15:48:48.951512 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [req-b7f1b978-0430-4aa3-8b32-2abf4f3a2d46 req-e71afcff-9d1d-4f37-b13c-afb184aa4708 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033979 May 23 15:48:48.952721 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 415/798] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:48:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:48:49.091552 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-275db491-2fe2-4662-9cd6-60ba9af68ec2 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:49.100923 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-275db491-2fe2-4662-9cd6-60ba9af68ec2 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:49.102440 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-275db491-2fe2-4662-9cd6-60ba9af68ec2 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:49.103585 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-275db491-2fe2-4662-9cd6-60ba9af68ec2 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 200 len: 1721 microversion: 2.20 time: 0.195657 May 23 15:48:49.104135 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 384/799] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:48:48 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 1721 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:48:49.578786 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-631b2ace-8e98-4198-9644-c19d8ced8e67 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:49.579485 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-631b2ace-8e98-4198-9644-c19d8ced8e67 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] [instance: dd66096c-0b64-4a26-bdec-1b1a46310cfb] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:49.586660 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-631b2ace-8e98-4198-9644-c19d8ced8e67 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:49.587115 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-631b2ace-8e98-4198-9644-c19d8ced8e67 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:49.587967 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-631b2ace-8e98-4198-9644-c19d8ced8e67 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:49.588407 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-631b2ace-8e98-4198-9644-c19d8ced8e67 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:49.649383 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-631b2ace-8e98-4198-9644-c19d8ced8e67 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b983c0a2a124ac3aa3403e0777612f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0860b3d072246d49cd43a900351d571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:49.656746 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-631b2ace-8e98-4198-9644-c19d8ced8e67 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] 10.222.0.64 "GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb" status: 200 len: 1219 microversion: 2.1 time: 0.082735 May 23 15:48:49.657330 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 416/800] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:48:49 2022] GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:48:50.124933 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-7332c36b-4e70-4e3b-9442-9b5e46615a69 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:50.125575 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-7332c36b-4e70-4e3b-9442-9b5e46615a69 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:50.132672 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-7332c36b-4e70-4e3b-9442-9b5e46615a69 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:50.133166 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-7332c36b-4e70-4e3b-9442-9b5e46615a69 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:50.133938 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-7332c36b-4e70-4e3b-9442-9b5e46615a69 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:50.134371 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-7332c36b-4e70-4e3b-9442-9b5e46615a69 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:50.265232 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-7332c36b-4e70-4e3b-9442-9b5e46615a69 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:50.273335 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-7332c36b-4e70-4e3b-9442-9b5e46615a69 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:50.274842 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-7332c36b-4e70-4e3b-9442-9b5e46615a69 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:50.275999 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-7332c36b-4e70-4e3b-9442-9b5e46615a69 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 200 len: 1721 microversion: 2.20 time: 0.154924 May 23 15:48:50.276559 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 385/801] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:48:50 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:48:50.674157 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-0a320997-8408-4b49-b41c-e8bc7cc1baae tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:50.675700 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-0a320997-8408-4b49-b41c-e8bc7cc1baae tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] [instance: dd66096c-0b64-4a26-bdec-1b1a46310cfb] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:50.682294 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0a320997-8408-4b49-b41c-e8bc7cc1baae tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:50.682783 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0a320997-8408-4b49-b41c-e8bc7cc1baae tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:50.683570 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0a320997-8408-4b49-b41c-e8bc7cc1baae tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:50.684004 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0a320997-8408-4b49-b41c-e8bc7cc1baae tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:50.749146 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-0a320997-8408-4b49-b41c-e8bc7cc1baae tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b983c0a2a124ac3aa3403e0777612f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0860b3d072246d49cd43a900351d571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:50.757234 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-0a320997-8408-4b49-b41c-e8bc7cc1baae tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] 10.222.0.64 "GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb" status: 200 len: 1219 microversion: 2.1 time: 0.087089 May 23 15:48:50.757976 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 417/802] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:48:50 2022] GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:48:51.293951 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-40ccb4e3-3deb-4eaf-9ce8-af023336d057 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:51.294587 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-40ccb4e3-3deb-4eaf-9ce8-af023336d057 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:51.301255 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-40ccb4e3-3deb-4eaf-9ce8-af023336d057 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:51.301780 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-40ccb4e3-3deb-4eaf-9ce8-af023336d057 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:51.302452 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-40ccb4e3-3deb-4eaf-9ce8-af023336d057 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:51.302994 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-40ccb4e3-3deb-4eaf-9ce8-af023336d057 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:51.442844 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-40ccb4e3-3deb-4eaf-9ce8-af023336d057 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:51.450742 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-40ccb4e3-3deb-4eaf-9ce8-af023336d057 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:51.452321 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-40ccb4e3-3deb-4eaf-9ce8-af023336d057 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:51.453513 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-40ccb4e3-3deb-4eaf-9ce8-af023336d057 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 200 len: 1721 microversion: 2.20 time: 0.163425 May 23 15:48:51.454075 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 386/803] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:48:51 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:48:51.774173 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-e09bcd69-a168-4e17-b896-b8fc4fe43c08 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:51.774792 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-e09bcd69-a168-4e17-b896-b8fc4fe43c08 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] [instance: dd66096c-0b64-4a26-bdec-1b1a46310cfb] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:51.781561 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e09bcd69-a168-4e17-b896-b8fc4fe43c08 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:51.782019 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e09bcd69-a168-4e17-b896-b8fc4fe43c08 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:51.782796 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e09bcd69-a168-4e17-b896-b8fc4fe43c08 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:51.783240 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e09bcd69-a168-4e17-b896-b8fc4fe43c08 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:51.821434 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e09bcd69-a168-4e17-b896-b8fc4fe43c08 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:51.821434 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e09bcd69-a168-4e17-b896-b8fc4fe43c08 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:51.821434 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.objects.instance [None req-e09bcd69-a168-4e17-b896-b8fc4fe43c08 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lazy-loading 'fault' on Instance uuid dd66096c-0b64-4a26-bdec-1b1a46310cfb {{(pid=124934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 15:48:51.861087 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-e09bcd69-a168-4e17-b896-b8fc4fe43c08 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b983c0a2a124ac3aa3403e0777612f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0860b3d072246d49cd43a900351d571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:51.867063 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-e09bcd69-a168-4e17-b896-b8fc4fe43c08 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] 10.222.0.64 "GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb" status: 200 len: 1224 microversion: 2.1 time: 0.096658 May 23 15:48:51.867634 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 418/804] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:48:51 2022] GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb => generated 1224 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:48:51.995998 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [req-010d2996-b682-41a1-9b85-dbca8ed6a94c req-1b5a25f5-1028-438d-b3d8-6f1484a832c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d9a9391-45aa-4e87-b025-839d2bf5c8a3", "name": "network-vif-unplugged", "status": "completed", "tag": "9f19c00b-8184-4f9a-bd54-44e27e1f300a"}]} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:48:52.004734 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-010d2996-b682-41a1-9b85-dbca8ed6a94c req-1b5a25f5-1028-438d-b3d8-6f1484a832c0 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:52.005369 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-010d2996-b682-41a1-9b85-dbca8ed6a94c req-1b5a25f5-1028-438d-b3d8-6f1484a832c0 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:52.016243 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.compute.server_external_events [req-010d2996-b682-41a1-9b85-dbca8ed6a94c req-1b5a25f5-1028-438d-b3d8-6f1484a832c0 service nova] Creating event network-vif-unplugged:9f19c00b-8184-4f9a-bd54-44e27e1f300a for instance 9d9a9391-45aa-4e87-b025-839d2bf5c8a3 on hv-cinder-84067 May 23 15:48:52.022700 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [req-010d2996-b682-41a1-9b85-dbca8ed6a94c req-1b5a25f5-1028-438d-b3d8-6f1484a832c0 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030311 May 23 15:48:52.023304 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 387/805] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:48:52.472439 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-ad207a77-a44a-4e35-8ce6-d023acd82b9c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:52.473285 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-ad207a77-a44a-4e35-8ce6-d023acd82b9c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:52.479314 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ad207a77-a44a-4e35-8ce6-d023acd82b9c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:52.479776 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ad207a77-a44a-4e35-8ce6-d023acd82b9c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:52.480552 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ad207a77-a44a-4e35-8ce6-d023acd82b9c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:52.480992 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ad207a77-a44a-4e35-8ce6-d023acd82b9c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:52.610724 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-ad207a77-a44a-4e35-8ce6-d023acd82b9c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:52.618885 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-ad207a77-a44a-4e35-8ce6-d023acd82b9c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:52.620417 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-ad207a77-a44a-4e35-8ce6-d023acd82b9c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:52.621614 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-ad207a77-a44a-4e35-8ce6-d023acd82b9c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 200 len: 1664 microversion: 2.20 time: 0.153701 May 23 15:48:52.622172 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 419/806] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:48:52 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 1664 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:48:52.640468 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-7dd5e78e-1134-4e11-a588-9dc0fda7e7e6 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d92e89fc-5971-4678-88f9-b578a4146f98"}} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:48:52.641611 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-7dd5e78e-1134-4e11-a588-9dc0fda7e7e6 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:52.648721 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-7dd5e78e-1134-4e11-a588-9dc0fda7e7e6 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:52.649202 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-7dd5e78e-1134-4e11-a588-9dc0fda7e7e6 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:52.649972 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-7dd5e78e-1134-4e11-a588-9dc0fda7e7e6 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:52.650404 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-7dd5e78e-1134-4e11-a588-9dc0fda7e7e6 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:52.885031 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-905c849b-b5ad-4b20-a906-5f7ca09c31b2 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:52.885881 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-905c849b-b5ad-4b20-a906-5f7ca09c31b2 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] [instance: dd66096c-0b64-4a26-bdec-1b1a46310cfb] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:52.893444 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-905c849b-b5ad-4b20-a906-5f7ca09c31b2 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:52.894763 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-905c849b-b5ad-4b20-a906-5f7ca09c31b2 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:52.895624 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-905c849b-b5ad-4b20-a906-5f7ca09c31b2 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:52.896071 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-905c849b-b5ad-4b20-a906-5f7ca09c31b2 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:52.909987 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.wsgi [None req-905c849b-b5ad-4b20-a906-5f7ca09c31b2 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] HTTP exception thrown: Instance dd66096c-0b64-4a26-bdec-1b1a46310cfb could not be found. May 23 15:48:52.911748 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-905c849b-b5ad-4b20-a906-5f7ca09c31b2 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Request method failure captured: May 23 15:48:52.911748 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: request: GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb HTTP/1.1 May 23 15:48:52.911748 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Accept: application/json May 23 15:48:52.911748 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Accept-Encoding: identity May 23 15:48:52.911748 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Connection: close May 23 15:48:52.911748 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Content-Length: 0 May 23 15:48:52.911748 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Content-Type: application/json May 23 15:48:52.911748 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Host: 10.222.0.64 May 23 15:48:52.911748 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Openstack-System-Scope: None May 23 15:48:52.911748 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: User-Agent: python-urllib3/1.26.9 May 23 15:48:52.911748 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Auth-Token: gAAAAABii6t9DDrDkOJ6OOqWsO8-LIVQ9lTKVcWWGeM42WNP2gcb8a3EQHBEbvPfCQ_545fa13Vp4LFzdxQ619v8Uo6vsUHG9w314DkagSluiC3lbH-2kYM_PQr6PEBx45rXdXSwIMTjxf-obYwjyQcPGR7WRbALm7bxBuNHZF3fKbzLQL05Oj8 May 23 15:48:52.911748 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Domain-Id: None May 23 15:48:52.911748 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Domain-Name: None May 23 15:48:52.911748 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Identity-Status: Confirmed May 23 15:48:52.911748 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Is-Admin-Project: True May 23 15:48:52.911748 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Domain-Id: default May 23 15:48:52.911748 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Domain-Name: Default May 23 15:48:52.911748 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Id: e0860b3d072246d49cd43a900351d571 May 23 15:48:52.911748 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Name: tempest-TestShelveInstance-1906189635 May 23 15:48:52.911748 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Role: reader,member May 23 15:48:52.911748 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Roles: reader,member May 23 15:48:52.913425 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e0860b3d072246d49cd43a900351d571"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/e0860b3d072246d49cd43a900351d571"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e0860b3d072246d49cd43a900351d571"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_e0860b3d072246d49cd43a900351d571", "adminURL": "http://10.222.0.64:8080"}]}] May 23 15:48:52.913425 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant: tempest-TestShelveInstance-1906189635 May 23 15:48:52.913425 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant-Id: e0860b3d072246d49cd43a900351d571 May 23 15:48:52.913425 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant-Name: tempest-TestShelveInstance-1906189635 May 23 15:48:52.913425 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User: tempest-TestShelveInstance-1906189635-project May 23 15:48:52.913425 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Domain-Id: default May 23 15:48:52.913425 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Domain-Name: Default May 23 15:48:52.913425 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Id: 8b983c0a2a124ac3aa3403e0777612f7 May 23 15:48:52.913425 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Name: tempest-TestShelveInstance-1906189635-project May 23 15:48:52.913425 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: method: > May 23 15:48:52.913425 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: exception: Instance dd66096c-0b64-4a26-bdec-1b1a46310cfb could not be found. May 23 15:48:52.913425 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: action_args: {'id': 'dd66096c-0b64-4a26-bdec-1b1a46310cfb'} May 23 15:48:52.914544 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:48:52.914544 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:48:52.914544 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:48:52.914544 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:48:52.914544 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:48:52.914544 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:48:52.914544 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:48:52.914544 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:48:52.914544 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:48:52.914544 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:48:52.914544 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd66096c-0b64-4a26-bdec-1b1a46310cfb could not be found. May 23 15:48:52.914544 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:48:52.914544 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:48:52.914544 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:48:52.914544 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:48:52.914544 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:48:52.914544 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:48:52.914544 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:48:52.914544 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:48:52.914544 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:48:52.916199 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:48:52.916199 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 15:48:52.916199 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 15:48:52.916199 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:48:52.916199 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:48:52.916199 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:48:52.916199 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:48:52.916199 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd66096c-0b64-4a26-bdec-1b1a46310cfb could not be found. May 23 15:48:52.916199 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:48:52.916199 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:48:52.916199 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:48:52.916199 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:48:52.916199 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:48:52.916199 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:48:52.916199 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:48:52.916199 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:48:52.916199 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd66096c-0b64-4a26-bdec-1b1a46310cfb could not be found. May 23 15:48:52.916199 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:48:52.917816 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-905c849b-b5ad-4b20-a906-5f7ca09c31b2 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Returning 404 to user: Instance dd66096c-0b64-4a26-bdec-1b1a46310cfb could not be found. {{(pid=124934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:48:52.917816 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-905c849b-b5ad-4b20-a906-5f7ca09c31b2 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] 10.222.0.64 "GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb" status: 404 len: 111 microversion: 2.1 time: 0.032584 May 23 15:48:52.917816 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 420/807] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:48:52 2022] GET /compute/v2.1/servers/dd66096c-0b64-4a26-bdec-1b1a46310cfb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 15:48:53.142357 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-6ff19e0a-cd43-4ed1-a016-2d6e950ea266 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] Calling method '.version_select at 0x7fab570e1b80>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:53.212942 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-6ff19e0a-cd43-4ed1-a016-2d6e950ea266 tempest-TestShelveInstance-1906189635 tempest-TestShelveInstance-1906189635-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-503509047" status: 202 len: 0 microversion: 2.1 time: 0.074542 May 23 15:48:53.213537 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 421/808] 10.222.0.64 () {58 vars in 1250 bytes} [Mon May 23 15:48:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-503509047 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 23 15:48:53.673981 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-7dd5e78e-1134-4e11-a588-9dc0fda7e7e6 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "POST /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.037951 May 23 15:48:53.679565 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 388/809] 10.222.0.64 () {62 vars in 1363 bytes} [Mon May 23 15:48:52 2022] POST /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3/os-volume_attachments => generated 188 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 15:48:53.808497 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-be7c2ac5-e93c-48fd-9916-083897cf2f56 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:48:53.809191 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-be7c2ac5-e93c-48fd-9916-083897cf2f56 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:53.816784 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-be7c2ac5-e93c-48fd-9916-083897cf2f56 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:53.817276 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-be7c2ac5-e93c-48fd-9916-083897cf2f56 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:53.818061 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-be7c2ac5-e93c-48fd-9916-083897cf2f56 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:53.818650 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-be7c2ac5-e93c-48fd-9916-083897cf2f56 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:54.071765 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-be7c2ac5-e93c-48fd-9916-083897cf2f56 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "POST /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3/action" status: 202 len: 0 microversion: 2.20 time: 0.267209 May 23 15:48:54.072746 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 422/810] 10.222.0.64 () {62 vars in 1318 bytes} [Mon May 23 15:48:53 2022] POST /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3/action => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 23 15:48:54.080541 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-303ebd4c-0b3d-4c00-a165-9bf487d709d2 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:54.081781 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-303ebd4c-0b3d-4c00-a165-9bf487d709d2 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:54.088324 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-303ebd4c-0b3d-4c00-a165-9bf487d709d2 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:54.088783 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-303ebd4c-0b3d-4c00-a165-9bf487d709d2 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:54.089650 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-303ebd4c-0b3d-4c00-a165-9bf487d709d2 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:54.090092 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-303ebd4c-0b3d-4c00-a165-9bf487d709d2 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:54.317715 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-303ebd4c-0b3d-4c00-a165-9bf487d709d2 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:54.329087 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-303ebd4c-0b3d-4c00-a165-9bf487d709d2 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:54.330585 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-303ebd4c-0b3d-4c00-a165-9bf487d709d2 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:54.331972 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-303ebd4c-0b3d-4c00-a165-9bf487d709d2 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 200 len: 1750 microversion: 2.20 time: 0.255473 May 23 15:48:54.343686 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 389/811] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:48:54 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 1750 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 15:48:55.355316 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-c28a4a23-b072-40e9-9e4c-c96e9e64f4b4 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:55.357296 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-c28a4a23-b072-40e9-9e4c-c96e9e64f4b4 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:55.367935 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-c28a4a23-b072-40e9-9e4c-c96e9e64f4b4 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:55.368439 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-c28a4a23-b072-40e9-9e4c-c96e9e64f4b4 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:55.369403 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-c28a4a23-b072-40e9-9e4c-c96e9e64f4b4 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:55.369736 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-c28a4a23-b072-40e9-9e4c-c96e9e64f4b4 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:55.531787 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-c28a4a23-b072-40e9-9e4c-c96e9e64f4b4 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:55.541778 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-c28a4a23-b072-40e9-9e4c-c96e9e64f4b4 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:55.543275 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-c28a4a23-b072-40e9-9e4c-c96e9e64f4b4 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:55.544441 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-c28a4a23-b072-40e9-9e4c-c96e9e64f4b4 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 200 len: 1750 microversion: 2.20 time: 0.197928 May 23 15:48:55.544984 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 423/812] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:48:55 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 1750 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:48:56.567291 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-145d20fa-a3c9-4362-b541-241c4150e377 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:56.567914 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-145d20fa-a3c9-4362-b541-241c4150e377 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:56.580665 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-145d20fa-a3c9-4362-b541-241c4150e377 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:56.586454 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-145d20fa-a3c9-4362-b541-241c4150e377 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:56.587340 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-145d20fa-a3c9-4362-b541-241c4150e377 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:56.587957 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-145d20fa-a3c9-4362-b541-241c4150e377 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:57.028494 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-145d20fa-a3c9-4362-b541-241c4150e377 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:57.040903 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-145d20fa-a3c9-4362-b541-241c4150e377 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:57.042567 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-145d20fa-a3c9-4362-b541-241c4150e377 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:57.043851 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-145d20fa-a3c9-4362-b541-241c4150e377 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 200 len: 1752 microversion: 2.20 time: 0.484157 May 23 15:48:57.044668 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 390/813] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:48:56 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 1752 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:48:58.063044 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-79133647-4198-4f28-9817-90b34b4d70db tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:58.063759 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-79133647-4198-4f28-9817-90b34b4d70db tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:58.071477 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-79133647-4198-4f28-9817-90b34b4d70db tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:58.072015 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-79133647-4198-4f28-9817-90b34b4d70db tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:58.073047 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-79133647-4198-4f28-9817-90b34b4d70db tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:58.073506 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-79133647-4198-4f28-9817-90b34b4d70db tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:58.410993 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-79133647-4198-4f28-9817-90b34b4d70db tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:58.420313 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-79133647-4198-4f28-9817-90b34b4d70db tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:58.422255 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-79133647-4198-4f28-9817-90b34b4d70db tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:58.423440 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-79133647-4198-4f28-9817-90b34b4d70db tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 200 len: 1808 microversion: 2.20 time: 0.364353 May 23 15:48:58.423987 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 424/814] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:48:58 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 1808 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:48:59.443693 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-1cf7232a-2de6-4239-9b1b-edfd380ee473 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:48:59.444462 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-1cf7232a-2de6-4239-9b1b-edfd380ee473 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:48:59.452632 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1cf7232a-2de6-4239-9b1b-edfd380ee473 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:59.453519 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1cf7232a-2de6-4239-9b1b-edfd380ee473 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:59.454927 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1cf7232a-2de6-4239-9b1b-edfd380ee473 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:48:59.455755 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1cf7232a-2de6-4239-9b1b-edfd380ee473 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:48:59.713537 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-1cf7232a-2de6-4239-9b1b-edfd380ee473 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:59.734862 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-1cf7232a-2de6-4239-9b1b-edfd380ee473 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:59.734862 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-1cf7232a-2de6-4239-9b1b-edfd380ee473 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:48:59.734862 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-1cf7232a-2de6-4239-9b1b-edfd380ee473 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 200 len: 1808 microversion: 2.20 time: 0.294006 May 23 15:48:59.767401 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 391/815] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:48:59 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 1808 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:49:00.768372 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-eebc5ebd-6e8a-49a6-8458-b5d1fe6bcf7c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:49:00.770404 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-eebc5ebd-6e8a-49a6-8458-b5d1fe6bcf7c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:49:00.788551 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-eebc5ebd-6e8a-49a6-8458-b5d1fe6bcf7c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:00.789428 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-eebc5ebd-6e8a-49a6-8458-b5d1fe6bcf7c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:00.790525 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-eebc5ebd-6e8a-49a6-8458-b5d1fe6bcf7c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:00.791180 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-eebc5ebd-6e8a-49a6-8458-b5d1fe6bcf7c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:01.458835 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-eebc5ebd-6e8a-49a6-8458-b5d1fe6bcf7c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:49:01.471932 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-eebc5ebd-6e8a-49a6-8458-b5d1fe6bcf7c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:49:01.473814 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-eebc5ebd-6e8a-49a6-8458-b5d1fe6bcf7c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:49:01.479498 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-eebc5ebd-6e8a-49a6-8458-b5d1fe6bcf7c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 200 len: 1808 microversion: 2.20 time: 0.711028 May 23 15:49:01.479498 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 425/816] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:49:00 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 1808 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:49:02.496963 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-c8ded10c-d40b-4a48-a8ee-3b7421f16c30 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:49:02.497863 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-c8ded10c-d40b-4a48-a8ee-3b7421f16c30 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:49:02.506026 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c8ded10c-d40b-4a48-a8ee-3b7421f16c30 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:02.506830 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c8ded10c-d40b-4a48-a8ee-3b7421f16c30 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:02.507819 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c8ded10c-d40b-4a48-a8ee-3b7421f16c30 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:02.508523 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c8ded10c-d40b-4a48-a8ee-3b7421f16c30 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:02.787273 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-c8ded10c-d40b-4a48-a8ee-3b7421f16c30 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:49:02.798654 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-c8ded10c-d40b-4a48-a8ee-3b7421f16c30 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:49:02.801826 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-c8ded10c-d40b-4a48-a8ee-3b7421f16c30 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:49:02.803505 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-c8ded10c-d40b-4a48-a8ee-3b7421f16c30 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 200 len: 1808 microversion: 2.20 time: 0.310241 May 23 15:49:02.816630 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 392/817] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:49:02 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 1808 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 15:49:03.823547 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-c0db2fc1-4d98-461e-b9a6-ccb3804adfb1 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:49:03.824795 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-c0db2fc1-4d98-461e-b9a6-ccb3804adfb1 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:49:03.836480 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-c0db2fc1-4d98-461e-b9a6-ccb3804adfb1 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:03.842146 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-c0db2fc1-4d98-461e-b9a6-ccb3804adfb1 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:03.854133 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-c0db2fc1-4d98-461e-b9a6-ccb3804adfb1 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:03.854599 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-c0db2fc1-4d98-461e-b9a6-ccb3804adfb1 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:04.153712 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-c0db2fc1-4d98-461e-b9a6-ccb3804adfb1 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:49:04.157344 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:49:04.163151 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-c0db2fc1-4d98-461e-b9a6-ccb3804adfb1 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:49:04.164795 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-c0db2fc1-4d98-461e-b9a6-ccb3804adfb1 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:49:04.166063 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-c0db2fc1-4d98-461e-b9a6-ccb3804adfb1 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 200 len: 1808 microversion: 2.20 time: 0.346780 May 23 15:49:04.166693 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 426/818] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:49:03 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 1808 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:49:04.782823 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-59399508-0620-4c09-b1bb-5ea658244980 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:49:04.783716 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-59399508-0620-4c09-b1bb-5ea658244980 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 78181bea-41e3-4044-b9e4-9c3700fb9037] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:49:04.794537 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-59399508-0620-4c09-b1bb-5ea658244980 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:04.795094 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-59399508-0620-4c09-b1bb-5ea658244980 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:04.805349 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-59399508-0620-4c09-b1bb-5ea658244980 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:04.805349 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-59399508-0620-4c09-b1bb-5ea658244980 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:04.830543 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-59399508-0620-4c09-b1bb-5ea658244980 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/78181bea-41e3-4044-b9e4-9c3700fb9037/ips" status: 200 len: 150 microversion: 2.1 time: 0.052993 May 23 15:49:04.834937 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 393/819] 10.222.0.64 () {58 vars in 1247 bytes} [Mon May 23 15:49:04 2022] GET /compute/v2.1/servers/78181bea-41e3-4044-b9e4-9c3700fb9037/ips => generated 150 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:49:05.186142 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-7d66db8b-4b3f-42ad-997c-060cb6a09eb0 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:49:05.186712 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-7d66db8b-4b3f-42ad-997c-060cb6a09eb0 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:49:05.208034 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-7d66db8b-4b3f-42ad-997c-060cb6a09eb0 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:05.208542 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-7d66db8b-4b3f-42ad-997c-060cb6a09eb0 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:05.209440 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-7d66db8b-4b3f-42ad-997c-060cb6a09eb0 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:05.209895 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-7d66db8b-4b3f-42ad-997c-060cb6a09eb0 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:05.380759 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-7d66db8b-4b3f-42ad-997c-060cb6a09eb0 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:49:05.393755 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-7d66db8b-4b3f-42ad-997c-060cb6a09eb0 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:49:05.395649 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-7d66db8b-4b3f-42ad-997c-060cb6a09eb0 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:49:05.397305 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-7d66db8b-4b3f-42ad-997c-060cb6a09eb0 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 200 len: 1808 microversion: 2.20 time: 0.215243 May 23 15:49:05.398056 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 427/820] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:49:05 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 1808 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:49:06.416084 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-e32f167d-4e86-431f-88c2-9691c60ce8cd tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:49:06.416667 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-e32f167d-4e86-431f-88c2-9691c60ce8cd tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:49:06.423491 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e32f167d-4e86-431f-88c2-9691c60ce8cd tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:06.423948 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e32f167d-4e86-431f-88c2-9691c60ce8cd tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:06.425931 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e32f167d-4e86-431f-88c2-9691c60ce8cd tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:06.426380 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e32f167d-4e86-431f-88c2-9691c60ce8cd tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:06.590895 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-e32f167d-4e86-431f-88c2-9691c60ce8cd tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:49:06.597832 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-e32f167d-4e86-431f-88c2-9691c60ce8cd tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:49:06.599347 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-e32f167d-4e86-431f-88c2-9691c60ce8cd tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:49:06.600526 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-e32f167d-4e86-431f-88c2-9691c60ce8cd tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 200 len: 1808 microversion: 2.20 time: 0.188495 May 23 15:49:06.601138 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 394/821] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:49:06 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 1808 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:49:07.620495 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-19dd631b-2afc-42c7-aca3-179adfdb7373 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:49:07.622160 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-19dd631b-2afc-42c7-aca3-179adfdb7373 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:49:07.635842 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-19dd631b-2afc-42c7-aca3-179adfdb7373 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:07.637639 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-19dd631b-2afc-42c7-aca3-179adfdb7373 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:07.638725 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-19dd631b-2afc-42c7-aca3-179adfdb7373 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:07.640762 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-19dd631b-2afc-42c7-aca3-179adfdb7373 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:07.700080 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-52bc3a1c-36af-4253-9952-57525227842a tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "81b65abd-a7e6-4acf-90d3-6679be1fbc87"}} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:49:07.709036 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-52bc3a1c-36af-4253-9952-57525227842a tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 78181bea-41e3-4044-b9e4-9c3700fb9037] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:49:07.718829 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-52bc3a1c-36af-4253-9952-57525227842a tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:07.719528 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-52bc3a1c-36af-4253-9952-57525227842a tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:07.720493 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-52bc3a1c-36af-4253-9952-57525227842a tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:07.721196 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-52bc3a1c-36af-4253-9952-57525227842a tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:07.917179 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-19dd631b-2afc-42c7-aca3-179adfdb7373 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:49:07.927443 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-19dd631b-2afc-42c7-aca3-179adfdb7373 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:49:07.929390 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-19dd631b-2afc-42c7-aca3-179adfdb7373 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:49:07.930831 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-19dd631b-2afc-42c7-aca3-179adfdb7373 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 200 len: 1808 microversion: 2.20 time: 0.314785 May 23 15:49:07.943630 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 428/822] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:49:07 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 1808 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:49:08.950306 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-97428587-939f-42fd-aefc-d32c94254652 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:49:08.950939 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-97428587-939f-42fd-aefc-d32c94254652 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:49:08.958192 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-97428587-939f-42fd-aefc-d32c94254652 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:08.960103 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-97428587-939f-42fd-aefc-d32c94254652 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:08.960103 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-97428587-939f-42fd-aefc-d32c94254652 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:08.960103 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-97428587-939f-42fd-aefc-d32c94254652 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:09.103483 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-97428587-939f-42fd-aefc-d32c94254652 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:49:09.113658 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-97428587-939f-42fd-aefc-d32c94254652 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:49:09.115171 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-97428587-939f-42fd-aefc-d32c94254652 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:49:09.116346 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-97428587-939f-42fd-aefc-d32c94254652 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 200 len: 1808 microversion: 2.20 time: 0.169899 May 23 15:49:09.116897 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 429/823] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:49:08 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 15:49:09.257039 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:49:09.461415 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-52bc3a1c-36af-4253-9952-57525227842a tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "POST /compute/v2.1/servers/78181bea-41e3-4044-b9e4-9c3700fb9037/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.765116 May 23 15:49:09.462042 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 395/824] 10.222.0.64 () {60 vars in 1322 bytes} [Mon May 23 15:49:07 2022] POST /compute/v2.1/servers/78181bea-41e3-4044-b9e4-9c3700fb9037/os-volume_attachments => generated 194 bytes in 1767 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:49:10.134708 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-66546842-4451-4101-8123-3ec56c69439e tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:49:10.135323 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-66546842-4451-4101-8123-3ec56c69439e tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:49:10.141723 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-66546842-4451-4101-8123-3ec56c69439e tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:10.142178 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-66546842-4451-4101-8123-3ec56c69439e tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:10.142943 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-66546842-4451-4101-8123-3ec56c69439e tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:10.143972 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-66546842-4451-4101-8123-3ec56c69439e tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:10.276689 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-66546842-4451-4101-8123-3ec56c69439e tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:49:10.281559 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-66546842-4451-4101-8123-3ec56c69439e tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:49:10.283166 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-66546842-4451-4101-8123-3ec56c69439e tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:49:10.285180 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-66546842-4451-4101-8123-3ec56c69439e tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 200 len: 1808 microversion: 2.20 time: 0.154277 May 23 15:49:10.285731 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 430/825] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:49:10 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:49:11.306273 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-24748ddf-d7fd-442f-88c5-cd2c28afa8f9 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:49:11.307007 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-24748ddf-d7fd-442f-88c5-cd2c28afa8f9 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:49:11.313810 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-24748ddf-d7fd-442f-88c5-cd2c28afa8f9 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:11.314254 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-24748ddf-d7fd-442f-88c5-cd2c28afa8f9 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:11.315690 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-24748ddf-d7fd-442f-88c5-cd2c28afa8f9 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:11.316114 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-24748ddf-d7fd-442f-88c5-cd2c28afa8f9 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:11.451408 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-24748ddf-d7fd-442f-88c5-cd2c28afa8f9 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:49:11.460838 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-24748ddf-d7fd-442f-88c5-cd2c28afa8f9 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:49:11.462463 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-24748ddf-d7fd-442f-88c5-cd2c28afa8f9 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:49:11.463673 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-24748ddf-d7fd-442f-88c5-cd2c28afa8f9 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 200 len: 1808 microversion: 2.20 time: 0.162912 May 23 15:49:11.469176 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 396/826] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:49:11 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:49:12.482275 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-4c4b56ee-f06b-438a-9ae4-70ba47374322 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:49:12.482923 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-4c4b56ee-f06b-438a-9ae4-70ba47374322 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:49:12.485326 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_api:SELECT=51,nova_api:DELETE=1 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:49:12.490236 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4c4b56ee-f06b-438a-9ae4-70ba47374322 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:12.495921 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4c4b56ee-f06b-438a-9ae4-70ba47374322 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:12.495921 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4c4b56ee-f06b-438a-9ae4-70ba47374322 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:12.495921 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4c4b56ee-f06b-438a-9ae4-70ba47374322 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:12.627393 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-4c4b56ee-f06b-438a-9ae4-70ba47374322 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:49:12.636804 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-4c4b56ee-f06b-438a-9ae4-70ba47374322 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:49:12.638331 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-4c4b56ee-f06b-438a-9ae4-70ba47374322 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:49:12.639509 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-4c4b56ee-f06b-438a-9ae4-70ba47374322 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 200 len: 1808 microversion: 2.20 time: 0.161283 May 23 15:49:12.640050 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 431/827] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:49:12 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:49:13.658433 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-a78301b5-d001-4769-84f6-aff167c1d55c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:49:13.659042 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-a78301b5-d001-4769-84f6-aff167c1d55c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:49:13.666741 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a78301b5-d001-4769-84f6-aff167c1d55c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:13.667189 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a78301b5-d001-4769-84f6-aff167c1d55c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:13.667983 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a78301b5-d001-4769-84f6-aff167c1d55c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:13.668420 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a78301b5-d001-4769-84f6-aff167c1d55c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:13.804698 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-a78301b5-d001-4769-84f6-aff167c1d55c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:49:13.812965 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-a78301b5-d001-4769-84f6-aff167c1d55c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:49:13.814764 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-a78301b5-d001-4769-84f6-aff167c1d55c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:49:13.815907 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-a78301b5-d001-4769-84f6-aff167c1d55c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 200 len: 1808 microversion: 2.20 time: 0.161536 May 23 15:49:13.817417 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 397/828] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:49:13 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:49:14.835059 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-61b5efa9-e8ce-4835-a3d3-78d546b4bd53 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:49:14.835681 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-61b5efa9-e8ce-4835-a3d3-78d546b4bd53 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:49:14.842207 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-61b5efa9-e8ce-4835-a3d3-78d546b4bd53 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:14.849729 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-61b5efa9-e8ce-4835-a3d3-78d546b4bd53 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:14.849729 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-61b5efa9-e8ce-4835-a3d3-78d546b4bd53 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:14.849729 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-61b5efa9-e8ce-4835-a3d3-78d546b4bd53 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:14.975283 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-61b5efa9-e8ce-4835-a3d3-78d546b4bd53 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:49:14.983705 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-61b5efa9-e8ce-4835-a3d3-78d546b4bd53 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:49:14.985246 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-61b5efa9-e8ce-4835-a3d3-78d546b4bd53 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:49:14.986413 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-61b5efa9-e8ce-4835-a3d3-78d546b4bd53 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 200 len: 1808 microversion: 2.20 time: 0.155341 May 23 15:49:14.986971 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 432/829] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:49:14 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:49:16.005929 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-06f1dcfd-bc96-462b-a4d5-e6563545d3fe tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:49:16.006544 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-06f1dcfd-bc96-462b-a4d5-e6563545d3fe tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:49:16.008986 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:49:16.013732 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-06f1dcfd-bc96-462b-a4d5-e6563545d3fe tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:16.014188 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-06f1dcfd-bc96-462b-a4d5-e6563545d3fe tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:16.014964 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-06f1dcfd-bc96-462b-a4d5-e6563545d3fe tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:16.015436 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-06f1dcfd-bc96-462b-a4d5-e6563545d3fe tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:16.171654 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-06f1dcfd-bc96-462b-a4d5-e6563545d3fe tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:49:16.181522 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-06f1dcfd-bc96-462b-a4d5-e6563545d3fe tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:49:16.183058 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-06f1dcfd-bc96-462b-a4d5-e6563545d3fe tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:49:16.184241 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-06f1dcfd-bc96-462b-a4d5-e6563545d3fe tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 200 len: 1808 microversion: 2.20 time: 0.183573 May 23 15:49:16.184809 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 398/830] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:49:15 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:49:17.058636 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-280b8778-f9ae-40d6-ab69-ed1ade8410c0 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:49:17.058636 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-280b8778-f9ae-40d6-ab69-ed1ade8410c0 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 78181bea-41e3-4044-b9e4-9c3700fb9037] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:49:17.060734 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-280b8778-f9ae-40d6-ab69-ed1ade8410c0 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:17.061233 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-280b8778-f9ae-40d6-ab69-ed1ade8410c0 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:17.062011 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-280b8778-f9ae-40d6-ab69-ed1ade8410c0 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:17.062462 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-280b8778-f9ae-40d6-ab69-ed1ade8410c0 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:17.144969 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.objects.instance [None req-280b8778-f9ae-40d6-ab69-ed1ade8410c0 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lazy-loading 'services' on Instance uuid 78181bea-41e3-4044-b9e4-9c3700fb9037 {{(pid=124934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 15:49:17.203271 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-231e883a-8a51-4b89-8ea1-7c6bffbd0cd6 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:49:17.203880 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-231e883a-8a51-4b89-8ea1-7c6bffbd0cd6 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:49:17.210904 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-231e883a-8a51-4b89-8ea1-7c6bffbd0cd6 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:17.213390 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-231e883a-8a51-4b89-8ea1-7c6bffbd0cd6 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:17.213390 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-231e883a-8a51-4b89-8ea1-7c6bffbd0cd6 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:17.213390 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-231e883a-8a51-4b89-8ea1-7c6bffbd0cd6 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:17.352515 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-231e883a-8a51-4b89-8ea1-7c6bffbd0cd6 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:49:17.361161 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-231e883a-8a51-4b89-8ea1-7c6bffbd0cd6 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:49:17.362660 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-231e883a-8a51-4b89-8ea1-7c6bffbd0cd6 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:49:17.363923 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-231e883a-8a51-4b89-8ea1-7c6bffbd0cd6 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 200 len: 1808 microversion: 2.20 time: 0.164856 May 23 15:49:17.364475 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 399/831] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:49:17 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:49:17.377127 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-280b8778-f9ae-40d6-ab69-ed1ade8410c0 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "DELETE /compute/v2.1/servers/78181bea-41e3-4044-b9e4-9c3700fb9037/os-volume_attachments/81b65abd-a7e6-4acf-90d3-6679be1fbc87" status: 202 len: 0 microversion: 2.1 time: 0.328212 May 23 15:49:17.377721 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 433/832] 10.222.0.64 () {58 vars in 1415 bytes} [Mon May 23 15:49:17 2022] DELETE /compute/v2.1/servers/78181bea-41e3-4044-b9e4-9c3700fb9037/os-volume_attachments/81b65abd-a7e6-4acf-90d3-6679be1fbc87 => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 15:49:17.386456 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-a4f94efe-8d33-4e58-9587-56305109076d tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:49:17.387454 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-a4f94efe-8d33-4e58-9587-56305109076d tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 78181bea-41e3-4044-b9e4-9c3700fb9037] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:49:17.397295 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a4f94efe-8d33-4e58-9587-56305109076d tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:17.397842 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a4f94efe-8d33-4e58-9587-56305109076d tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:17.398992 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a4f94efe-8d33-4e58-9587-56305109076d tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:17.399431 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a4f94efe-8d33-4e58-9587-56305109076d tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:17.429879 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-a4f94efe-8d33-4e58-9587-56305109076d tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/78181bea-41e3-4044-b9e4-9c3700fb9037/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047630 May 23 15:49:17.430433 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 400/833] 10.222.0.64 () {58 vars in 1301 bytes} [Mon May 23 15:49:17 2022] GET /compute/v2.1/servers/78181bea-41e3-4044-b9e4-9c3700fb9037/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:49:18.059650 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [req-7e2f38db-fc4f-4a95-88d4-fd265f288d9f req-87a67a66-5dc2-418d-ab19-7030c50beb46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d9a9391-45aa-4e87-b025-839d2bf5c8a3", "name": "network-vif-plugged", "status": "completed", "tag": "9f19c00b-8184-4f9a-bd54-44e27e1f300a"}]} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:49:18.069947 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-7e2f38db-fc4f-4a95-88d4-fd265f288d9f req-87a67a66-5dc2-418d-ab19-7030c50beb46 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:18.070644 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-7e2f38db-fc4f-4a95-88d4-fd265f288d9f req-87a67a66-5dc2-418d-ab19-7030c50beb46 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:18.083646 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.compute.server_external_events [req-7e2f38db-fc4f-4a95-88d4-fd265f288d9f req-87a67a66-5dc2-418d-ab19-7030c50beb46 service nova] Creating event network-vif-plugged:9f19c00b-8184-4f9a-bd54-44e27e1f300a for instance 9d9a9391-45aa-4e87-b025-839d2bf5c8a3 on hv-cinder-84067 May 23 15:49:18.090940 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [req-7e2f38db-fc4f-4a95-88d4-fd265f288d9f req-87a67a66-5dc2-418d-ab19-7030c50beb46 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036694 May 23 15:49:18.091910 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 434/834] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:49:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:49:18.382707 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-2bece669-7c92-4880-b174-5aadf4935683 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:49:18.383317 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-2bece669-7c92-4880-b174-5aadf4935683 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:49:18.390012 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-2bece669-7c92-4880-b174-5aadf4935683 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:18.390466 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-2bece669-7c92-4880-b174-5aadf4935683 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:18.391293 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-2bece669-7c92-4880-b174-5aadf4935683 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:18.391731 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-2bece669-7c92-4880-b174-5aadf4935683 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:18.444979 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-2d927dfc-f94e-43ba-99d2-6656c876f94c tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:49:18.446267 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-2d927dfc-f94e-43ba-99d2-6656c876f94c tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 78181bea-41e3-4044-b9e4-9c3700fb9037] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:49:18.453229 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2d927dfc-f94e-43ba-99d2-6656c876f94c tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:18.454135 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2d927dfc-f94e-43ba-99d2-6656c876f94c tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:18.455242 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2d927dfc-f94e-43ba-99d2-6656c876f94c tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:18.455681 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2d927dfc-f94e-43ba-99d2-6656c876f94c tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:18.491431 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-2d927dfc-f94e-43ba-99d2-6656c876f94c tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/78181bea-41e3-4044-b9e4-9c3700fb9037/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052633 May 23 15:49:18.491992 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 435/835] 10.222.0.64 () {58 vars in 1301 bytes} [Mon May 23 15:49:18 2022] GET /compute/v2.1/servers/78181bea-41e3-4044-b9e4-9c3700fb9037/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:49:18.527327 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-2bece669-7c92-4880-b174-5aadf4935683 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:49:18.536276 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-2bece669-7c92-4880-b174-5aadf4935683 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:49:18.537838 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-2bece669-7c92-4880-b174-5aadf4935683 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:49:18.538996 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-2bece669-7c92-4880-b174-5aadf4935683 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 200 len: 1808 microversion: 2.20 time: 0.160531 May 23 15:49:18.539551 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 401/836] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:49:18 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:49:19.503204 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-c2b673c9-4f1f-4ff8-9d5d-afc28f758b91 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:49:19.504662 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-c2b673c9-4f1f-4ff8-9d5d-afc28f758b91 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 78181bea-41e3-4044-b9e4-9c3700fb9037] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:49:19.511392 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-c2b673c9-4f1f-4ff8-9d5d-afc28f758b91 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:19.511874 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-c2b673c9-4f1f-4ff8-9d5d-afc28f758b91 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:19.512635 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-c2b673c9-4f1f-4ff8-9d5d-afc28f758b91 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:19.513119 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-c2b673c9-4f1f-4ff8-9d5d-afc28f758b91 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:19.543493 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-c2b673c9-4f1f-4ff8-9d5d-afc28f758b91 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/78181bea-41e3-4044-b9e4-9c3700fb9037/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044422 May 23 15:49:19.544049 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 436/837] 10.222.0.64 () {58 vars in 1301 bytes} [Mon May 23 15:49:19 2022] GET /compute/v2.1/servers/78181bea-41e3-4044-b9e4-9c3700fb9037/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:49:19.557676 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-5b271dc6-99bf-4d22-93e1-02362f5c623d tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:49:19.558499 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-5b271dc6-99bf-4d22-93e1-02362f5c623d tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:49:19.564842 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-5b271dc6-99bf-4d22-93e1-02362f5c623d tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:19.565325 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-5b271dc6-99bf-4d22-93e1-02362f5c623d tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:19.566154 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-5b271dc6-99bf-4d22-93e1-02362f5c623d tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:19.567219 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-5b271dc6-99bf-4d22-93e1-02362f5c623d tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:19.697569 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-5b271dc6-99bf-4d22-93e1-02362f5c623d tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:49:19.706025 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-5b271dc6-99bf-4d22-93e1-02362f5c623d tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:49:19.709341 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-5b271dc6-99bf-4d22-93e1-02362f5c623d tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:49:19.710544 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-5b271dc6-99bf-4d22-93e1-02362f5c623d tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 200 len: 1808 microversion: 2.20 time: 0.156781 May 23 15:49:19.711105 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 402/838] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:49:19 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:49:20.555379 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-2f627f03-b0ad-4919-896d-9fc082166901 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:49:20.556301 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-2f627f03-b0ad-4919-896d-9fc082166901 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 78181bea-41e3-4044-b9e4-9c3700fb9037] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:49:20.562751 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2f627f03-b0ad-4919-896d-9fc082166901 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:20.563200 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2f627f03-b0ad-4919-896d-9fc082166901 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:20.563969 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2f627f03-b0ad-4919-896d-9fc082166901 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:20.564405 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2f627f03-b0ad-4919-896d-9fc082166901 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:20.593423 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-2f627f03-b0ad-4919-896d-9fc082166901 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/78181bea-41e3-4044-b9e4-9c3700fb9037/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042104 May 23 15:49:20.593966 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 437/839] 10.222.0.64 () {58 vars in 1301 bytes} [Mon May 23 15:49:20 2022] GET /compute/v2.1/servers/78181bea-41e3-4044-b9e4-9c3700fb9037/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:49:20.729324 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-7fcf8033-dc7b-4d21-933b-8bb8d080f605 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:49:20.729965 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-7fcf8033-dc7b-4d21-933b-8bb8d080f605 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:49:20.736399 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-7fcf8033-dc7b-4d21-933b-8bb8d080f605 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:20.736852 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-7fcf8033-dc7b-4d21-933b-8bb8d080f605 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:20.737643 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-7fcf8033-dc7b-4d21-933b-8bb8d080f605 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:20.738111 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-7fcf8033-dc7b-4d21-933b-8bb8d080f605 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:20.865555 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-7fcf8033-dc7b-4d21-933b-8bb8d080f605 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:49:20.873786 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-7fcf8033-dc7b-4d21-933b-8bb8d080f605 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:49:20.875295 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-7fcf8033-dc7b-4d21-933b-8bb8d080f605 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:49:20.876426 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-7fcf8033-dc7b-4d21-933b-8bb8d080f605 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 200 len: 1808 microversion: 2.20 time: 0.151102 May 23 15:49:20.879021 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 403/840] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:49:20 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:49:21.604816 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-a067db43-930b-4a7f-9774-9a2fbadc98d2 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:49:21.605747 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-a067db43-930b-4a7f-9774-9a2fbadc98d2 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 78181bea-41e3-4044-b9e4-9c3700fb9037] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:49:21.612104 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-a067db43-930b-4a7f-9774-9a2fbadc98d2 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:21.612554 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-a067db43-930b-4a7f-9774-9a2fbadc98d2 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:21.614095 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-a067db43-930b-4a7f-9774-9a2fbadc98d2 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:21.614529 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-a067db43-930b-4a7f-9774-9a2fbadc98d2 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:21.642662 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-a067db43-930b-4a7f-9774-9a2fbadc98d2 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/78181bea-41e3-4044-b9e4-9c3700fb9037/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041672 May 23 15:49:21.643130 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 438/841] 10.222.0.64 () {58 vars in 1301 bytes} [Mon May 23 15:49:21 2022] GET /compute/v2.1/servers/78181bea-41e3-4044-b9e4-9c3700fb9037/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:49:21.895604 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-57fd0d85-22e4-459d-bcdf-b4b31496630e tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:49:21.896138 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-57fd0d85-22e4-459d-bcdf-b4b31496630e tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:49:21.903146 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-57fd0d85-22e4-459d-bcdf-b4b31496630e tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:21.903594 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-57fd0d85-22e4-459d-bcdf-b4b31496630e tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:21.904427 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-57fd0d85-22e4-459d-bcdf-b4b31496630e tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:21.904858 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-57fd0d85-22e4-459d-bcdf-b4b31496630e tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:22.041822 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-57fd0d85-22e4-459d-bcdf-b4b31496630e tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:49:22.051490 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-57fd0d85-22e4-459d-bcdf-b4b31496630e tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:49:22.053175 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-57fd0d85-22e4-459d-bcdf-b4b31496630e tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:49:22.054334 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-57fd0d85-22e4-459d-bcdf-b4b31496630e tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 200 len: 1808 microversion: 2.20 time: 0.162927 May 23 15:49:22.054972 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 404/842] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:49:21 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:49:22.656105 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-a3c50bae-6a55-47dc-b208-602e7e87e3f7 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:49:22.657563 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-a3c50bae-6a55-47dc-b208-602e7e87e3f7 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 78181bea-41e3-4044-b9e4-9c3700fb9037] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:49:22.665393 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-a3c50bae-6a55-47dc-b208-602e7e87e3f7 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:22.665849 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-a3c50bae-6a55-47dc-b208-602e7e87e3f7 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:22.666624 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-a3c50bae-6a55-47dc-b208-602e7e87e3f7 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:22.667063 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-a3c50bae-6a55-47dc-b208-602e7e87e3f7 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:22.696983 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-a3c50bae-6a55-47dc-b208-602e7e87e3f7 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/78181bea-41e3-4044-b9e4-9c3700fb9037/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044923 May 23 15:49:22.697709 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 439/843] 10.222.0.64 () {58 vars in 1301 bytes} [Mon May 23 15:49:22 2022] GET /compute/v2.1/servers/78181bea-41e3-4044-b9e4-9c3700fb9037/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 15:49:22.762517 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-6f28b743-8ae4-4636-acc8-85da650daea8 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:49:22.763300 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-6f28b743-8ae4-4636-acc8-85da650daea8 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 78181bea-41e3-4044-b9e4-9c3700fb9037] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:49:22.770592 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-6f28b743-8ae4-4636-acc8-85da650daea8 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:22.771042 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-6f28b743-8ae4-4636-acc8-85da650daea8 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:22.771816 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-6f28b743-8ae4-4636-acc8-85da650daea8 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:22.772421 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-6f28b743-8ae4-4636-acc8-85da650daea8 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:22.973321 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-6f28b743-8ae4-4636-acc8-85da650daea8 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 78181bea-41e3-4044-b9e4-9c3700fb9037] Going to try to terminate instance {{(pid=124933) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 15:49:23.073912 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-36e07a0f-ae99-4722-89d4-b2bdac581da5 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:49:23.074542 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-36e07a0f-ae99-4722-89d4-b2bdac581da5 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:49:23.080582 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-36e07a0f-ae99-4722-89d4-b2bdac581da5 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:23.081033 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-36e07a0f-ae99-4722-89d4-b2bdac581da5 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:23.082765 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-36e07a0f-ae99-4722-89d4-b2bdac581da5 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:23.083332 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-36e07a0f-ae99-4722-89d4-b2bdac581da5 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:23.227899 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-36e07a0f-ae99-4722-89d4-b2bdac581da5 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:49:23.237501 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-36e07a0f-ae99-4722-89d4-b2bdac581da5 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:49:23.240190 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-36e07a0f-ae99-4722-89d4-b2bdac581da5 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:49:23.241779 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-36e07a0f-ae99-4722-89d4-b2bdac581da5 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 200 len: 1808 microversion: 2.20 time: 0.172213 May 23 15:49:23.248456 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 440/844] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:49:23 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 15:49:23.273858 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-6f28b743-8ae4-4636-acc8-85da650daea8 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "DELETE /compute/v2.1/servers/78181bea-41e3-4044-b9e4-9c3700fb9037" status: 204 len: 0 microversion: 2.1 time: 0.518740 May 23 15:49:23.274442 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 405/845] 10.222.0.64 () {58 vars in 1238 bytes} [Mon May 23 15:49:22 2022] DELETE /compute/v2.1/servers/78181bea-41e3-4044-b9e4-9c3700fb9037 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 15:49:23.282605 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-c2dc8c31-732e-4251-a18f-45978ee46835 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:49:23.283218 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-c2dc8c31-732e-4251-a18f-45978ee46835 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 78181bea-41e3-4044-b9e4-9c3700fb9037] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:49:23.289661 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-c2dc8c31-732e-4251-a18f-45978ee46835 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:23.290113 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-c2dc8c31-732e-4251-a18f-45978ee46835 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:23.290992 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-c2dc8c31-732e-4251-a18f-45978ee46835 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:23.291406 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-c2dc8c31-732e-4251-a18f-45978ee46835 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:23.428740 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-c2dc8c31-732e-4251-a18f-45978ee46835 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:49:23.436380 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-c2dc8c31-732e-4251-a18f-45978ee46835 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/78181bea-41e3-4044-b9e4-9c3700fb9037" status: 200 len: 1681 microversion: 2.1 time: 0.157447 May 23 15:49:23.436928 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 441/846] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:49:23 2022] GET /compute/v2.1/servers/78181bea-41e3-4044-b9e4-9c3700fb9037 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:49:24.260463 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-090fa8c9-bff7-4d83-ac59-e6c4797a4844 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:49:24.261199 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-090fa8c9-bff7-4d83-ac59-e6c4797a4844 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:49:24.267829 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-090fa8c9-bff7-4d83-ac59-e6c4797a4844 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:24.268283 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-090fa8c9-bff7-4d83-ac59-e6c4797a4844 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:24.269685 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-090fa8c9-bff7-4d83-ac59-e6c4797a4844 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:24.270175 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-090fa8c9-bff7-4d83-ac59-e6c4797a4844 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:24.401568 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-090fa8c9-bff7-4d83-ac59-e6c4797a4844 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:49:24.410250 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-090fa8c9-bff7-4d83-ac59-e6c4797a4844 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:49:24.411749 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-090fa8c9-bff7-4d83-ac59-e6c4797a4844 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:49:24.412943 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-090fa8c9-bff7-4d83-ac59-e6c4797a4844 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 200 len: 1808 microversion: 2.20 time: 0.156778 May 23 15:49:24.413532 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 406/847] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:49:24 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:49:24.455076 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-207cd702-8622-4285-87aa-4ecb6aa734c7 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:49:24.455818 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-207cd702-8622-4285-87aa-4ecb6aa734c7 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 78181bea-41e3-4044-b9e4-9c3700fb9037] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:49:24.463027 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-207cd702-8622-4285-87aa-4ecb6aa734c7 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:24.463476 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-207cd702-8622-4285-87aa-4ecb6aa734c7 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:24.464238 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-207cd702-8622-4285-87aa-4ecb6aa734c7 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:24.464676 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-207cd702-8622-4285-87aa-4ecb6aa734c7 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:24.594224 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-207cd702-8622-4285-87aa-4ecb6aa734c7 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:49:24.601674 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-207cd702-8622-4285-87aa-4ecb6aa734c7 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/78181bea-41e3-4044-b9e4-9c3700fb9037" status: 200 len: 1681 microversion: 2.1 time: 0.150618 May 23 15:49:24.602236 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 442/848] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:49:24 2022] GET /compute/v2.1/servers/78181bea-41e3-4044-b9e4-9c3700fb9037 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:49:25.431463 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-b76e6898-3527-4d37-a5af-89bef1238242 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:49:25.432073 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-b76e6898-3527-4d37-a5af-89bef1238242 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:49:25.438728 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b76e6898-3527-4d37-a5af-89bef1238242 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:25.439187 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b76e6898-3527-4d37-a5af-89bef1238242 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:25.439972 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b76e6898-3527-4d37-a5af-89bef1238242 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:25.440415 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b76e6898-3527-4d37-a5af-89bef1238242 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:25.618828 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-3b0fa9a1-eef6-4b90-a46a-1148cf12ffca tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:49:25.619454 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-3b0fa9a1-eef6-4b90-a46a-1148cf12ffca tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 78181bea-41e3-4044-b9e4-9c3700fb9037] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:49:25.626149 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3b0fa9a1-eef6-4b90-a46a-1148cf12ffca tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:25.626661 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3b0fa9a1-eef6-4b90-a46a-1148cf12ffca tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:25.627439 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3b0fa9a1-eef6-4b90-a46a-1148cf12ffca tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:25.627920 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3b0fa9a1-eef6-4b90-a46a-1148cf12ffca tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:25.646751 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:49:25.709642 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-b76e6898-3527-4d37-a5af-89bef1238242 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:49:25.719121 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-b76e6898-3527-4d37-a5af-89bef1238242 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:49:25.720855 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-b76e6898-3527-4d37-a5af-89bef1238242 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:49:25.722140 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-b76e6898-3527-4d37-a5af-89bef1238242 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 200 len: 1795 microversion: 2.20 time: 0.294552 May 23 15:49:25.723371 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 407/849] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:49:25 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 1795 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:49:25.829947 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-3b0fa9a1-eef6-4b90-a46a-1148cf12ffca tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:49:25.838105 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-3b0fa9a1-eef6-4b90-a46a-1148cf12ffca tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/78181bea-41e3-4044-b9e4-9c3700fb9037" status: 200 len: 1681 microversion: 2.1 time: 0.223155 May 23 15:49:25.838712 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 443/850] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:49:25 2022] GET /compute/v2.1/servers/78181bea-41e3-4044-b9e4-9c3700fb9037 => generated 1681 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:49:26.239562 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [req-8c0662ee-e8b2-43a0-b0ae-a7bd3b738a44 req-de4bd112-1471-4546-bff5-0f0e700773c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78181bea-41e3-4044-b9e4-9c3700fb9037", "name": "network-vif-deleted", "tag": "6f5eff2d-445b-4844-b500-782ab519f384"}]} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:49:26.248961 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-8c0662ee-e8b2-43a0-b0ae-a7bd3b738a44 req-de4bd112-1471-4546-bff5-0f0e700773c1 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:26.254523 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-8c0662ee-e8b2-43a0-b0ae-a7bd3b738a44 req-de4bd112-1471-4546-bff5-0f0e700773c1 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:26.261072 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.compute.server_external_events [req-8c0662ee-e8b2-43a0-b0ae-a7bd3b738a44 req-de4bd112-1471-4546-bff5-0f0e700773c1 service nova] Creating event network-vif-deleted:6f5eff2d-445b-4844-b500-782ab519f384 for instance 78181bea-41e3-4044-b9e4-9c3700fb9037 on hv-cinder-84067 May 23 15:49:26.266083 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [req-8c0662ee-e8b2-43a0-b0ae-a7bd3b738a44 req-de4bd112-1471-4546-bff5-0f0e700773c1 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030780 May 23 15:49:26.266769 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 408/851] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:49:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:49:26.855372 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-41041bd3-e3f9-49d8-9100-bbd746882c3c tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:49:26.855905 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-41041bd3-e3f9-49d8-9100-bbd746882c3c tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 78181bea-41e3-4044-b9e4-9c3700fb9037] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:49:26.863732 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-41041bd3-e3f9-49d8-9100-bbd746882c3c tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:26.864293 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-41041bd3-e3f9-49d8-9100-bbd746882c3c tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:26.865086 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-41041bd3-e3f9-49d8-9100-bbd746882c3c tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:26.865533 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-41041bd3-e3f9-49d8-9100-bbd746882c3c tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:26.898236 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-41041bd3-e3f9-49d8-9100-bbd746882c3c tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:26.898716 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-41041bd3-e3f9-49d8-9100-bbd746882c3c tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:26.899172 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.objects.instance [None req-41041bd3-e3f9-49d8-9100-bbd746882c3c tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lazy-loading 'fault' on Instance uuid 78181bea-41e3-4044-b9e4-9c3700fb9037 {{(pid=124934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 15:49:26.947257 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-41041bd3-e3f9-49d8-9100-bbd746882c3c tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '472049224bbf48699b8a9410ec61aa9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15ae9d15a64468f80628ed51c2e42d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:49:26.957835 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-41041bd3-e3f9-49d8-9100-bbd746882c3c tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/78181bea-41e3-4044-b9e4-9c3700fb9037" status: 200 len: 1331 microversion: 2.1 time: 0.105824 May 23 15:49:26.959288 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 444/852] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:49:26 2022] GET /compute/v2.1/servers/78181bea-41e3-4044-b9e4-9c3700fb9037 => generated 1331 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:49:27.979836 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-ac12cfe4-6985-4c7d-9895-9d089f24f3c4 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:49:27.980541 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-ac12cfe4-6985-4c7d-9895-9d089f24f3c4 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 78181bea-41e3-4044-b9e4-9c3700fb9037] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:49:27.986690 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ac12cfe4-6985-4c7d-9895-9d089f24f3c4 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:27.987141 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ac12cfe4-6985-4c7d-9895-9d089f24f3c4 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:27.988469 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ac12cfe4-6985-4c7d-9895-9d089f24f3c4 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:27.988904 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ac12cfe4-6985-4c7d-9895-9d089f24f3c4 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:28.001999 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.wsgi [None req-ac12cfe4-6985-4c7d-9895-9d089f24f3c4 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] HTTP exception thrown: Instance 78181bea-41e3-4044-b9e4-9c3700fb9037 could not be found. May 23 15:49:28.004186 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-ac12cfe4-6985-4c7d-9895-9d089f24f3c4 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Request method failure captured: May 23 15:49:28.004186 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: request: GET /compute/v2.1/servers/78181bea-41e3-4044-b9e4-9c3700fb9037 HTTP/1.1 May 23 15:49:28.004186 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Accept: application/json May 23 15:49:28.004186 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Accept-Encoding: identity May 23 15:49:28.004186 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Connection: close May 23 15:49:28.004186 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Content-Length: 0 May 23 15:49:28.004186 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Content-Type: application/json May 23 15:49:28.004186 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Host: 10.222.0.64 May 23 15:49:28.004186 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Openstack-System-Scope: None May 23 15:49:28.004186 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: User-Agent: python-urllib3/1.26.9 May 23 15:49:28.004186 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Auth-Token: gAAAAABii6uOGntB7Pc55mvjpSIsPzNLOlywCYGbr_-Vzy5_quOX_mjNj5PwEdU1U5x_QaGgk51iZzj3S4TZVzOIWCHWkRILSGjcG5ZDd1N2DadGTyYCWvrZ0p61UD6zAV5lw6yOUFVzzVm3KSoYQSF_ZlPFocwbQbQqnGoN6Tr34TmSqfoSNW8 May 23 15:49:28.004186 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Domain-Id: None May 23 15:49:28.004186 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Domain-Name: None May 23 15:49:28.004186 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Identity-Status: Confirmed May 23 15:49:28.004186 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Is-Admin-Project: True May 23 15:49:28.004186 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Domain-Id: default May 23 15:49:28.004186 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Domain-Name: Default May 23 15:49:28.004186 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Id: a15ae9d15a64468f80628ed51c2e42d6 May 23 15:49:28.004186 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Name: tempest-AttachVolumeNegativeTest-2009285566 May 23 15:49:28.004186 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Role: reader,member May 23 15:49:28.004186 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Roles: reader,member May 23 15:49:28.005659 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a15ae9d15a64468f80628ed51c2e42d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a15ae9d15a64468f80628ed51c2e42d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a15ae9d15a64468f80628ed51c2e42d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a15ae9d15a64468f80628ed51c2e42d6", "adminURL": "http://10.222.0.64:8080"}]}] May 23 15:49:28.005659 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant: tempest-AttachVolumeNegativeTest-2009285566 May 23 15:49:28.005659 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant-Id: a15ae9d15a64468f80628ed51c2e42d6 May 23 15:49:28.005659 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2009285566 May 23 15:49:28.005659 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User: tempest-AttachVolumeNegativeTest-2009285566-project May 23 15:49:28.005659 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Domain-Id: default May 23 15:49:28.005659 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Domain-Name: Default May 23 15:49:28.005659 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Id: 472049224bbf48699b8a9410ec61aa9e May 23 15:49:28.005659 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Name: tempest-AttachVolumeNegativeTest-2009285566-project May 23 15:49:28.005659 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: method: > May 23 15:49:28.005659 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: exception: Instance 78181bea-41e3-4044-b9e4-9c3700fb9037 could not be found. May 23 15:49:28.005659 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: action_args: {'id': '78181bea-41e3-4044-b9e4-9c3700fb9037'} May 23 15:49:28.006502 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:49:28.006502 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:49:28.006502 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:49:28.006502 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:49:28.006502 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:49:28.006502 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:49:28.006502 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:49:28.006502 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:49:28.006502 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:49:28.006502 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:49:28.006502 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78181bea-41e3-4044-b9e4-9c3700fb9037 could not be found. May 23 15:49:28.006502 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:49:28.006502 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:49:28.006502 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:49:28.006502 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:49:28.006502 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:49:28.006502 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:49:28.006502 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:49:28.006502 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:49:28.006502 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:49:28.008041 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:49:28.008041 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 15:49:28.008041 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 15:49:28.008041 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:49:28.008041 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:49:28.008041 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:49:28.008041 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:49:28.008041 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78181bea-41e3-4044-b9e4-9c3700fb9037 could not be found. May 23 15:49:28.008041 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:49:28.008041 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:49:28.008041 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:49:28.008041 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:49:28.008041 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:49:28.008041 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:49:28.008041 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:49:28.008041 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:49:28.008041 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78181bea-41e3-4044-b9e4-9c3700fb9037 could not be found. May 23 15:49:28.008041 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:49:28.009564 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-ac12cfe4-6985-4c7d-9895-9d089f24f3c4 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Returning 404 to user: Instance 78181bea-41e3-4044-b9e4-9c3700fb9037 could not be found. {{(pid=124933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:49:28.009564 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-ac12cfe4-6985-4c7d-9895-9d089f24f3c4 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/78181bea-41e3-4044-b9e4-9c3700fb9037" status: 404 len: 111 microversion: 2.1 time: 0.030653 May 23 15:49:28.009564 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 409/853] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:49:27 2022] GET /compute/v2.1/servers/78181bea-41e3-4044-b9e4-9c3700fb9037 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 15:49:28.015241 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-5a17681a-9f2e-4d3c-9768-44096ec0f1b0 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '.version_select at 0x7fab51e77430>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:49:28.087057 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-5a17681a-9f2e-4d3c-9768-44096ec0f1b0 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2020239585" status: 202 len: 0 microversion: 2.1 time: 0.075989 May 23 15:49:28.087645 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 445/854] 10.222.0.64 () {58 vars in 1220 bytes} [Mon May 23 15:49:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2020239585 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 15:49:30.378056 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-813b4233-c4b4-44d9-81f9-fe99a0806a44 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:49:30.378599 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-813b4233-c4b4-44d9-81f9-fe99a0806a44 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 78181bea-41e3-4044-b9e4-9c3700fb9037] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:49:30.385407 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-813b4233-c4b4-44d9-81f9-fe99a0806a44 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:30.385866 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-813b4233-c4b4-44d9-81f9-fe99a0806a44 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:30.386650 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-813b4233-c4b4-44d9-81f9-fe99a0806a44 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:30.387118 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-813b4233-c4b4-44d9-81f9-fe99a0806a44 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:30.400621 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.wsgi [None req-813b4233-c4b4-44d9-81f9-fe99a0806a44 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] HTTP exception thrown: Instance 78181bea-41e3-4044-b9e4-9c3700fb9037 could not be found. May 23 15:49:30.402200 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-813b4233-c4b4-44d9-81f9-fe99a0806a44 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Request method failure captured: May 23 15:49:30.402200 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: request: DELETE /compute/v2.1/servers/78181bea-41e3-4044-b9e4-9c3700fb9037 HTTP/1.1 May 23 15:49:30.402200 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Accept: application/json May 23 15:49:30.402200 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Accept-Encoding: identity May 23 15:49:30.402200 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Connection: close May 23 15:49:30.402200 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Content-Length: 0 May 23 15:49:30.402200 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Content-Type: application/json May 23 15:49:30.402200 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Host: 10.222.0.64 May 23 15:49:30.402200 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Openstack-System-Scope: None May 23 15:49:30.402200 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: User-Agent: python-urllib3/1.26.9 May 23 15:49:30.402200 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Auth-Token: gAAAAABii6uOGntB7Pc55mvjpSIsPzNLOlywCYGbr_-Vzy5_quOX_mjNj5PwEdU1U5x_QaGgk51iZzj3S4TZVzOIWCHWkRILSGjcG5ZDd1N2DadGTyYCWvrZ0p61UD6zAV5lw6yOUFVzzVm3KSoYQSF_ZlPFocwbQbQqnGoN6Tr34TmSqfoSNW8 May 23 15:49:30.402200 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Domain-Id: None May 23 15:49:30.402200 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Domain-Name: None May 23 15:49:30.402200 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Identity-Status: Confirmed May 23 15:49:30.402200 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Is-Admin-Project: True May 23 15:49:30.402200 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Domain-Id: default May 23 15:49:30.402200 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Domain-Name: Default May 23 15:49:30.402200 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Id: a15ae9d15a64468f80628ed51c2e42d6 May 23 15:49:30.402200 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Name: tempest-AttachVolumeNegativeTest-2009285566 May 23 15:49:30.402200 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Role: reader,member May 23 15:49:30.402200 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Roles: reader,member May 23 15:49:30.403792 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a15ae9d15a64468f80628ed51c2e42d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a15ae9d15a64468f80628ed51c2e42d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a15ae9d15a64468f80628ed51c2e42d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a15ae9d15a64468f80628ed51c2e42d6", "adminURL": "http://10.222.0.64:8080"}]}] May 23 15:49:30.403792 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant: tempest-AttachVolumeNegativeTest-2009285566 May 23 15:49:30.403792 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant-Id: a15ae9d15a64468f80628ed51c2e42d6 May 23 15:49:30.403792 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2009285566 May 23 15:49:30.403792 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User: tempest-AttachVolumeNegativeTest-2009285566-project May 23 15:49:30.403792 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Domain-Id: default May 23 15:49:30.403792 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Domain-Name: Default May 23 15:49:30.403792 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Id: 472049224bbf48699b8a9410ec61aa9e May 23 15:49:30.403792 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Name: tempest-AttachVolumeNegativeTest-2009285566-project May 23 15:49:30.403792 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: method: > May 23 15:49:30.403792 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: exception: Instance 78181bea-41e3-4044-b9e4-9c3700fb9037 could not be found. May 23 15:49:30.403792 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: action_args: {'id': '78181bea-41e3-4044-b9e4-9c3700fb9037'} May 23 15:49:30.404744 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:49:30.404744 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:49:30.404744 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:49:30.404744 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:49:30.404744 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:49:30.404744 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:49:30.404744 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:49:30.404744 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:49:30.404744 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:49:30.404744 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:49:30.404744 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78181bea-41e3-4044-b9e4-9c3700fb9037 could not be found. May 23 15:49:30.404744 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:49:30.404744 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:49:30.404744 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:49:30.404744 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:49:30.404744 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:49:30.404744 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:49:30.404744 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:49:30.404744 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:49:30.404744 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:49:30.406289 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:49:30.406289 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 15:49:30.406289 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 15:49:30.406289 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 15:49:30.406289 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 15:49:30.406289 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:49:30.406289 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:49:30.406289 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:49:30.406289 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:49:30.406289 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78181bea-41e3-4044-b9e4-9c3700fb9037 could not be found. May 23 15:49:30.406289 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:49:30.406289 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:49:30.406289 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:49:30.406289 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:49:30.406289 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:49:30.406289 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:49:30.406289 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:49:30.406289 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:49:30.406289 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78181bea-41e3-4044-b9e4-9c3700fb9037 could not be found. May 23 15:49:30.406289 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:49:30.408096 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-813b4233-c4b4-44d9-81f9-fe99a0806a44 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Returning 404 to user: Instance 78181bea-41e3-4044-b9e4-9c3700fb9037 could not be found. {{(pid=124933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:49:30.408096 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-813b4233-c4b4-44d9-81f9-fe99a0806a44 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "DELETE /compute/v2.1/servers/78181bea-41e3-4044-b9e4-9c3700fb9037" status: 404 len: 111 microversion: 2.1 time: 0.029910 May 23 15:49:30.408096 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 410/855] 10.222.0.64 () {58 vars in 1238 bytes} [Mon May 23 15:49:30 2022] DELETE /compute/v2.1/servers/78181bea-41e3-4044-b9e4-9c3700fb9037 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 15:49:30.412607 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-9d8dfbc2-321b-4dce-908a-dbb14c2fe109 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:49:30.413244 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-9d8dfbc2-321b-4dce-908a-dbb14c2fe109 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 78181bea-41e3-4044-b9e4-9c3700fb9037] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:49:30.419840 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-9d8dfbc2-321b-4dce-908a-dbb14c2fe109 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:30.420289 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-9d8dfbc2-321b-4dce-908a-dbb14c2fe109 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:30.421095 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-9d8dfbc2-321b-4dce-908a-dbb14c2fe109 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:30.421532 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-9d8dfbc2-321b-4dce-908a-dbb14c2fe109 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:30.435468 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.wsgi [None req-9d8dfbc2-321b-4dce-908a-dbb14c2fe109 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] HTTP exception thrown: Instance 78181bea-41e3-4044-b9e4-9c3700fb9037 could not be found. May 23 15:49:30.437312 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-9d8dfbc2-321b-4dce-908a-dbb14c2fe109 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Request method failure captured: May 23 15:49:30.437312 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: request: GET /compute/v2.1/servers/78181bea-41e3-4044-b9e4-9c3700fb9037 HTTP/1.1 May 23 15:49:30.437312 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Accept: application/json May 23 15:49:30.437312 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Accept-Encoding: identity May 23 15:49:30.437312 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Connection: close May 23 15:49:30.437312 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Content-Length: 0 May 23 15:49:30.437312 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Content-Type: application/json May 23 15:49:30.437312 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Host: 10.222.0.64 May 23 15:49:30.437312 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Openstack-System-Scope: None May 23 15:49:30.437312 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: User-Agent: python-urllib3/1.26.9 May 23 15:49:30.437312 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Auth-Token: gAAAAABii6uOGntB7Pc55mvjpSIsPzNLOlywCYGbr_-Vzy5_quOX_mjNj5PwEdU1U5x_QaGgk51iZzj3S4TZVzOIWCHWkRILSGjcG5ZDd1N2DadGTyYCWvrZ0p61UD6zAV5lw6yOUFVzzVm3KSoYQSF_ZlPFocwbQbQqnGoN6Tr34TmSqfoSNW8 May 23 15:49:30.437312 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Domain-Id: None May 23 15:49:30.437312 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Domain-Name: None May 23 15:49:30.437312 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Identity-Status: Confirmed May 23 15:49:30.437312 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Is-Admin-Project: True May 23 15:49:30.437312 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Domain-Id: default May 23 15:49:30.437312 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Domain-Name: Default May 23 15:49:30.437312 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Id: a15ae9d15a64468f80628ed51c2e42d6 May 23 15:49:30.437312 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Name: tempest-AttachVolumeNegativeTest-2009285566 May 23 15:49:30.437312 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Role: reader,member May 23 15:49:30.437312 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Roles: reader,member May 23 15:49:30.438971 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a15ae9d15a64468f80628ed51c2e42d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a15ae9d15a64468f80628ed51c2e42d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a15ae9d15a64468f80628ed51c2e42d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a15ae9d15a64468f80628ed51c2e42d6", "adminURL": "http://10.222.0.64:8080"}]}] May 23 15:49:30.438971 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant: tempest-AttachVolumeNegativeTest-2009285566 May 23 15:49:30.438971 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant-Id: a15ae9d15a64468f80628ed51c2e42d6 May 23 15:49:30.438971 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2009285566 May 23 15:49:30.438971 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User: tempest-AttachVolumeNegativeTest-2009285566-project May 23 15:49:30.438971 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Domain-Id: default May 23 15:49:30.438971 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Domain-Name: Default May 23 15:49:30.438971 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Id: 472049224bbf48699b8a9410ec61aa9e May 23 15:49:30.438971 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Name: tempest-AttachVolumeNegativeTest-2009285566-project May 23 15:49:30.438971 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: method: > May 23 15:49:30.438971 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: exception: Instance 78181bea-41e3-4044-b9e4-9c3700fb9037 could not be found. May 23 15:49:30.438971 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: action_args: {'id': '78181bea-41e3-4044-b9e4-9c3700fb9037'} May 23 15:49:30.440226 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:49:30.440226 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:49:30.440226 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:49:30.440226 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:49:30.440226 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:49:30.440226 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:49:30.440226 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:49:30.440226 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:49:30.440226 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:49:30.440226 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:49:30.440226 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78181bea-41e3-4044-b9e4-9c3700fb9037 could not be found. May 23 15:49:30.440226 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:49:30.440226 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:49:30.440226 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:49:30.440226 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:49:30.440226 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:49:30.440226 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:49:30.440226 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:49:30.440226 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:49:30.440226 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:49:30.441803 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:49:30.441803 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 15:49:30.441803 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 15:49:30.441803 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:49:30.441803 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:49:30.441803 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:49:30.441803 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:49:30.441803 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78181bea-41e3-4044-b9e4-9c3700fb9037 could not be found. May 23 15:49:30.441803 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:49:30.441803 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:49:30.441803 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:49:30.441803 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:49:30.441803 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:49:30.441803 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:49:30.441803 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:49:30.441803 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:49:30.441803 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78181bea-41e3-4044-b9e4-9c3700fb9037 could not be found. May 23 15:49:30.441803 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:49:30.443351 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-9d8dfbc2-321b-4dce-908a-dbb14c2fe109 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Returning 404 to user: Instance 78181bea-41e3-4044-b9e4-9c3700fb9037 could not be found. {{(pid=124934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:49:30.443351 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-9d8dfbc2-321b-4dce-908a-dbb14c2fe109 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/78181bea-41e3-4044-b9e4-9c3700fb9037" status: 404 len: 111 microversion: 2.1 time: 0.030835 May 23 15:49:30.443351 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 446/856] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:49:30 2022] GET /compute/v2.1/servers/78181bea-41e3-4044-b9e4-9c3700fb9037 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 15:49:31.724133 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-39b74ee3-7a97-4991-98cc-f9952d31ec6f tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:49:31.724627 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-39b74ee3-7a97-4991-98cc-f9952d31ec6f tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 8393c1a9-60d1-4b54-947d-3ef1a2e56845] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:49:31.731064 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-39b74ee3-7a97-4991-98cc-f9952d31ec6f tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:31.731515 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-39b74ee3-7a97-4991-98cc-f9952d31ec6f tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:31.732283 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-39b74ee3-7a97-4991-98cc-f9952d31ec6f tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:31.732721 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-39b74ee3-7a97-4991-98cc-f9952d31ec6f tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:31.745814 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.wsgi [None req-39b74ee3-7a97-4991-98cc-f9952d31ec6f tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] HTTP exception thrown: Instance 8393c1a9-60d1-4b54-947d-3ef1a2e56845 could not be found. May 23 15:49:31.747401 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-39b74ee3-7a97-4991-98cc-f9952d31ec6f tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Request method failure captured: May 23 15:49:31.747401 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: request: DELETE /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845 HTTP/1.1 May 23 15:49:31.747401 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Accept: application/json May 23 15:49:31.747401 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Accept-Encoding: identity May 23 15:49:31.747401 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Connection: close May 23 15:49:31.747401 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Content-Length: 0 May 23 15:49:31.747401 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Content-Type: application/json May 23 15:49:31.747401 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Host: 10.222.0.64 May 23 15:49:31.747401 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Openstack-System-Scope: None May 23 15:49:31.747401 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: User-Agent: python-urllib3/1.26.9 May 23 15:49:31.747401 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Auth-Token: gAAAAABii6uOGntB7Pc55mvjpSIsPzNLOlywCYGbr_-Vzy5_quOX_mjNj5PwEdU1U5x_QaGgk51iZzj3S4TZVzOIWCHWkRILSGjcG5ZDd1N2DadGTyYCWvrZ0p61UD6zAV5lw6yOUFVzzVm3KSoYQSF_ZlPFocwbQbQqnGoN6Tr34TmSqfoSNW8 May 23 15:49:31.747401 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Domain-Id: None May 23 15:49:31.747401 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Domain-Name: None May 23 15:49:31.747401 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Identity-Status: Confirmed May 23 15:49:31.747401 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Is-Admin-Project: True May 23 15:49:31.747401 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Domain-Id: default May 23 15:49:31.747401 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Domain-Name: Default May 23 15:49:31.747401 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Id: a15ae9d15a64468f80628ed51c2e42d6 May 23 15:49:31.747401 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Name: tempest-AttachVolumeNegativeTest-2009285566 May 23 15:49:31.747401 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Role: reader,member May 23 15:49:31.747401 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Roles: reader,member May 23 15:49:31.748820 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a15ae9d15a64468f80628ed51c2e42d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a15ae9d15a64468f80628ed51c2e42d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a15ae9d15a64468f80628ed51c2e42d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a15ae9d15a64468f80628ed51c2e42d6", "adminURL": "http://10.222.0.64:8080"}]}] May 23 15:49:31.748820 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant: tempest-AttachVolumeNegativeTest-2009285566 May 23 15:49:31.748820 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant-Id: a15ae9d15a64468f80628ed51c2e42d6 May 23 15:49:31.748820 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2009285566 May 23 15:49:31.748820 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User: tempest-AttachVolumeNegativeTest-2009285566-project May 23 15:49:31.748820 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Domain-Id: default May 23 15:49:31.748820 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Domain-Name: Default May 23 15:49:31.748820 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Id: 472049224bbf48699b8a9410ec61aa9e May 23 15:49:31.748820 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Name: tempest-AttachVolumeNegativeTest-2009285566-project May 23 15:49:31.748820 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: method: > May 23 15:49:31.748820 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: exception: Instance 8393c1a9-60d1-4b54-947d-3ef1a2e56845 could not be found. May 23 15:49:31.748820 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: action_args: {'id': '8393c1a9-60d1-4b54-947d-3ef1a2e56845'} May 23 15:49:31.750197 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:49:31.750197 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:49:31.750197 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:49:31.750197 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:49:31.750197 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:49:31.750197 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:49:31.750197 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:49:31.750197 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:49:31.750197 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:49:31.750197 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:49:31.750197 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8393c1a9-60d1-4b54-947d-3ef1a2e56845 could not be found. May 23 15:49:31.750197 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:49:31.750197 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:49:31.750197 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:49:31.750197 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:49:31.750197 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:49:31.750197 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:49:31.750197 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:49:31.750197 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:49:31.750197 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:49:31.751480 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:49:31.751480 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 15:49:31.751480 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 15:49:31.751480 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 15:49:31.751480 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 15:49:31.751480 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:49:31.751480 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:49:31.751480 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:49:31.751480 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:49:31.751480 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8393c1a9-60d1-4b54-947d-3ef1a2e56845 could not be found. May 23 15:49:31.751480 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:49:31.751480 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:49:31.751480 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:49:31.751480 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:49:31.751480 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:49:31.751480 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:49:31.751480 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:49:31.751480 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:49:31.751480 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8393c1a9-60d1-4b54-947d-3ef1a2e56845 could not be found. May 23 15:49:31.751480 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:49:31.753113 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-39b74ee3-7a97-4991-98cc-f9952d31ec6f tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Returning 404 to user: Instance 8393c1a9-60d1-4b54-947d-3ef1a2e56845 could not be found. {{(pid=124933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:49:31.753113 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-39b74ee3-7a97-4991-98cc-f9952d31ec6f tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "DELETE /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845" status: 404 len: 111 microversion: 2.1 time: 0.029145 May 23 15:49:31.753113 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 411/857] 10.222.0.64 () {58 vars in 1238 bytes} [Mon May 23 15:49:31 2022] DELETE /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 15:49:31.758092 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-ed3c2446-650e-4f71-9e86-37121333e65f tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:49:31.758749 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-ed3c2446-650e-4f71-9e86-37121333e65f tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: 8393c1a9-60d1-4b54-947d-3ef1a2e56845] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:49:31.765569 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ed3c2446-650e-4f71-9e86-37121333e65f tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:31.766066 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ed3c2446-650e-4f71-9e86-37121333e65f tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:31.766548 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ed3c2446-650e-4f71-9e86-37121333e65f tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:31.766993 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ed3c2446-650e-4f71-9e86-37121333e65f tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:31.780917 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.wsgi [None req-ed3c2446-650e-4f71-9e86-37121333e65f tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] HTTP exception thrown: Instance 8393c1a9-60d1-4b54-947d-3ef1a2e56845 could not be found. May 23 15:49:31.782471 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-ed3c2446-650e-4f71-9e86-37121333e65f tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Request method failure captured: May 23 15:49:31.782471 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: request: GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845 HTTP/1.1 May 23 15:49:31.782471 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Accept: application/json May 23 15:49:31.782471 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Accept-Encoding: identity May 23 15:49:31.782471 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Connection: close May 23 15:49:31.782471 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Content-Length: 0 May 23 15:49:31.782471 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Content-Type: application/json May 23 15:49:31.782471 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Host: 10.222.0.64 May 23 15:49:31.782471 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Openstack-System-Scope: None May 23 15:49:31.782471 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: User-Agent: python-urllib3/1.26.9 May 23 15:49:31.782471 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Auth-Token: gAAAAABii6uOGntB7Pc55mvjpSIsPzNLOlywCYGbr_-Vzy5_quOX_mjNj5PwEdU1U5x_QaGgk51iZzj3S4TZVzOIWCHWkRILSGjcG5ZDd1N2DadGTyYCWvrZ0p61UD6zAV5lw6yOUFVzzVm3KSoYQSF_ZlPFocwbQbQqnGoN6Tr34TmSqfoSNW8 May 23 15:49:31.782471 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Domain-Id: None May 23 15:49:31.782471 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Domain-Name: None May 23 15:49:31.782471 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Identity-Status: Confirmed May 23 15:49:31.782471 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Is-Admin-Project: True May 23 15:49:31.782471 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Domain-Id: default May 23 15:49:31.782471 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Domain-Name: Default May 23 15:49:31.782471 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Id: a15ae9d15a64468f80628ed51c2e42d6 May 23 15:49:31.782471 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Name: tempest-AttachVolumeNegativeTest-2009285566 May 23 15:49:31.782471 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Role: reader,member May 23 15:49:31.782471 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Roles: reader,member May 23 15:49:31.784080 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a15ae9d15a64468f80628ed51c2e42d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a15ae9d15a64468f80628ed51c2e42d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a15ae9d15a64468f80628ed51c2e42d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a15ae9d15a64468f80628ed51c2e42d6", "adminURL": "http://10.222.0.64:8080"}]}] May 23 15:49:31.784080 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant: tempest-AttachVolumeNegativeTest-2009285566 May 23 15:49:31.784080 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant-Id: a15ae9d15a64468f80628ed51c2e42d6 May 23 15:49:31.784080 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2009285566 May 23 15:49:31.784080 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User: tempest-AttachVolumeNegativeTest-2009285566-project May 23 15:49:31.784080 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Domain-Id: default May 23 15:49:31.784080 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Domain-Name: Default May 23 15:49:31.784080 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Id: 472049224bbf48699b8a9410ec61aa9e May 23 15:49:31.784080 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Name: tempest-AttachVolumeNegativeTest-2009285566-project May 23 15:49:31.784080 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: method: > May 23 15:49:31.784080 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: exception: Instance 8393c1a9-60d1-4b54-947d-3ef1a2e56845 could not be found. May 23 15:49:31.784080 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: action_args: {'id': '8393c1a9-60d1-4b54-947d-3ef1a2e56845'} May 23 15:49:31.784990 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:49:31.784990 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:49:31.784990 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:49:31.784990 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:49:31.784990 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:49:31.784990 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:49:31.784990 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:49:31.784990 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:49:31.784990 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:49:31.784990 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:49:31.784990 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8393c1a9-60d1-4b54-947d-3ef1a2e56845 could not be found. May 23 15:49:31.784990 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:49:31.784990 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:49:31.784990 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:49:31.784990 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:49:31.784990 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:49:31.784990 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:49:31.784990 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:49:31.784990 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:49:31.784990 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:49:31.786596 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:49:31.786596 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 15:49:31.786596 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 15:49:31.786596 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:49:31.786596 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:49:31.786596 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:49:31.786596 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:49:31.786596 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8393c1a9-60d1-4b54-947d-3ef1a2e56845 could not be found. May 23 15:49:31.786596 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:49:31.786596 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:49:31.786596 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:49:31.786596 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:49:31.786596 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:49:31.786596 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:49:31.786596 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:49:31.786596 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:49:31.786596 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8393c1a9-60d1-4b54-947d-3ef1a2e56845 could not be found. May 23 15:49:31.786596 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:49:31.787953 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-ed3c2446-650e-4f71-9e86-37121333e65f tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Returning 404 to user: Instance 8393c1a9-60d1-4b54-947d-3ef1a2e56845 could not be found. {{(pid=124934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:49:31.787953 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-ed3c2446-650e-4f71-9e86-37121333e65f tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845" status: 404 len: 111 microversion: 2.1 time: 0.030285 May 23 15:49:31.787953 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 447/858] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:49:31 2022] GET /compute/v2.1/servers/8393c1a9-60d1-4b54-947d-3ef1a2e56845 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 23 15:49:31.792247 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-d724cf10-0e98-4de9-9c31-808a469efe6d tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:49:31.792691 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-d724cf10-0e98-4de9-9c31-808a469efe6d tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: aafabce5-30ac-488a-9d85-2d453337bf71] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:49:31.798789 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-d724cf10-0e98-4de9-9c31-808a469efe6d tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:31.799250 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-d724cf10-0e98-4de9-9c31-808a469efe6d tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:31.800292 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-d724cf10-0e98-4de9-9c31-808a469efe6d tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:31.800728 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-d724cf10-0e98-4de9-9c31-808a469efe6d tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:31.813960 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.wsgi [None req-d724cf10-0e98-4de9-9c31-808a469efe6d tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] HTTP exception thrown: Instance aafabce5-30ac-488a-9d85-2d453337bf71 could not be found. May 23 15:49:31.815484 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-d724cf10-0e98-4de9-9c31-808a469efe6d tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Request method failure captured: May 23 15:49:31.815484 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: request: DELETE /compute/v2.1/servers/aafabce5-30ac-488a-9d85-2d453337bf71 HTTP/1.1 May 23 15:49:31.815484 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Accept: application/json May 23 15:49:31.815484 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Accept-Encoding: identity May 23 15:49:31.815484 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Connection: close May 23 15:49:31.815484 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Content-Length: 0 May 23 15:49:31.815484 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Content-Type: application/json May 23 15:49:31.815484 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Host: 10.222.0.64 May 23 15:49:31.815484 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Openstack-System-Scope: None May 23 15:49:31.815484 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: User-Agent: python-urllib3/1.26.9 May 23 15:49:31.815484 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Auth-Token: gAAAAABii6uOGntB7Pc55mvjpSIsPzNLOlywCYGbr_-Vzy5_quOX_mjNj5PwEdU1U5x_QaGgk51iZzj3S4TZVzOIWCHWkRILSGjcG5ZDd1N2DadGTyYCWvrZ0p61UD6zAV5lw6yOUFVzzVm3KSoYQSF_ZlPFocwbQbQqnGoN6Tr34TmSqfoSNW8 May 23 15:49:31.815484 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Domain-Id: None May 23 15:49:31.815484 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Domain-Name: None May 23 15:49:31.815484 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Identity-Status: Confirmed May 23 15:49:31.815484 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Is-Admin-Project: True May 23 15:49:31.815484 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Domain-Id: default May 23 15:49:31.815484 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Domain-Name: Default May 23 15:49:31.815484 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Id: a15ae9d15a64468f80628ed51c2e42d6 May 23 15:49:31.815484 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Name: tempest-AttachVolumeNegativeTest-2009285566 May 23 15:49:31.815484 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Role: reader,member May 23 15:49:31.815484 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Roles: reader,member May 23 15:49:31.817946 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a15ae9d15a64468f80628ed51c2e42d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a15ae9d15a64468f80628ed51c2e42d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a15ae9d15a64468f80628ed51c2e42d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a15ae9d15a64468f80628ed51c2e42d6", "adminURL": "http://10.222.0.64:8080"}]}] May 23 15:49:31.817946 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant: tempest-AttachVolumeNegativeTest-2009285566 May 23 15:49:31.817946 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant-Id: a15ae9d15a64468f80628ed51c2e42d6 May 23 15:49:31.817946 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2009285566 May 23 15:49:31.817946 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User: tempest-AttachVolumeNegativeTest-2009285566-project May 23 15:49:31.817946 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Domain-Id: default May 23 15:49:31.817946 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Domain-Name: Default May 23 15:49:31.817946 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Id: 472049224bbf48699b8a9410ec61aa9e May 23 15:49:31.817946 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Name: tempest-AttachVolumeNegativeTest-2009285566-project May 23 15:49:31.817946 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: method: > May 23 15:49:31.817946 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: exception: Instance aafabce5-30ac-488a-9d85-2d453337bf71 could not be found. May 23 15:49:31.817946 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: action_args: {'id': 'aafabce5-30ac-488a-9d85-2d453337bf71'} May 23 15:49:31.819108 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:49:31.819108 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:49:31.819108 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:49:31.819108 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:49:31.819108 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:49:31.819108 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:49:31.819108 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:49:31.819108 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:49:31.819108 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:49:31.819108 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:49:31.819108 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aafabce5-30ac-488a-9d85-2d453337bf71 could not be found. May 23 15:49:31.819108 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:49:31.819108 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:49:31.819108 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:49:31.819108 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:49:31.819108 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:49:31.819108 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:49:31.819108 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:49:31.819108 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:49:31.819108 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:49:31.820741 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:49:31.820741 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 15:49:31.820741 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 15:49:31.820741 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 15:49:31.820741 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 15:49:31.820741 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:49:31.820741 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:49:31.820741 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:49:31.820741 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:49:31.820741 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aafabce5-30ac-488a-9d85-2d453337bf71 could not be found. May 23 15:49:31.820741 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:49:31.820741 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:49:31.820741 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:49:31.820741 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:49:31.820741 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:49:31.820741 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:49:31.820741 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:49:31.820741 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:49:31.820741 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aafabce5-30ac-488a-9d85-2d453337bf71 could not be found. May 23 15:49:31.820741 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:49:31.822270 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-d724cf10-0e98-4de9-9c31-808a469efe6d tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Returning 404 to user: Instance aafabce5-30ac-488a-9d85-2d453337bf71 could not be found. {{(pid=124933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:49:31.822270 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-d724cf10-0e98-4de9-9c31-808a469efe6d tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "DELETE /compute/v2.1/servers/aafabce5-30ac-488a-9d85-2d453337bf71" status: 404 len: 111 microversion: 2.1 time: 0.028454 May 23 15:49:31.822270 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 412/859] 10.222.0.64 () {58 vars in 1238 bytes} [Mon May 23 15:49:31 2022] DELETE /compute/v2.1/servers/aafabce5-30ac-488a-9d85-2d453337bf71 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 15:49:31.827484 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-8fb0b23e-2c65-4566-9c41-b4dbd9ba9bee tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:49:31.828093 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-8fb0b23e-2c65-4566-9c41-b4dbd9ba9bee tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: aafabce5-30ac-488a-9d85-2d453337bf71] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:49:31.834693 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-8fb0b23e-2c65-4566-9c41-b4dbd9ba9bee tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:31.835141 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-8fb0b23e-2c65-4566-9c41-b4dbd9ba9bee tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:31.835904 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-8fb0b23e-2c65-4566-9c41-b4dbd9ba9bee tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:31.836337 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-8fb0b23e-2c65-4566-9c41-b4dbd9ba9bee tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:31.849626 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.wsgi [None req-8fb0b23e-2c65-4566-9c41-b4dbd9ba9bee tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] HTTP exception thrown: Instance aafabce5-30ac-488a-9d85-2d453337bf71 could not be found. May 23 15:49:31.851142 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-8fb0b23e-2c65-4566-9c41-b4dbd9ba9bee tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Request method failure captured: May 23 15:49:31.851142 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: request: GET /compute/v2.1/servers/aafabce5-30ac-488a-9d85-2d453337bf71 HTTP/1.1 May 23 15:49:31.851142 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Accept: application/json May 23 15:49:31.851142 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Accept-Encoding: identity May 23 15:49:31.851142 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Connection: close May 23 15:49:31.851142 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Content-Length: 0 May 23 15:49:31.851142 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Content-Type: application/json May 23 15:49:31.851142 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Host: 10.222.0.64 May 23 15:49:31.851142 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Openstack-System-Scope: None May 23 15:49:31.851142 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: User-Agent: python-urllib3/1.26.9 May 23 15:49:31.851142 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Auth-Token: gAAAAABii6uOGntB7Pc55mvjpSIsPzNLOlywCYGbr_-Vzy5_quOX_mjNj5PwEdU1U5x_QaGgk51iZzj3S4TZVzOIWCHWkRILSGjcG5ZDd1N2DadGTyYCWvrZ0p61UD6zAV5lw6yOUFVzzVm3KSoYQSF_ZlPFocwbQbQqnGoN6Tr34TmSqfoSNW8 May 23 15:49:31.851142 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Domain-Id: None May 23 15:49:31.851142 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Domain-Name: None May 23 15:49:31.851142 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Identity-Status: Confirmed May 23 15:49:31.851142 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Is-Admin-Project: True May 23 15:49:31.851142 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Domain-Id: default May 23 15:49:31.851142 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Domain-Name: Default May 23 15:49:31.851142 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Id: a15ae9d15a64468f80628ed51c2e42d6 May 23 15:49:31.851142 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Name: tempest-AttachVolumeNegativeTest-2009285566 May 23 15:49:31.851142 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Role: reader,member May 23 15:49:31.851142 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Roles: reader,member May 23 15:49:31.852788 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a15ae9d15a64468f80628ed51c2e42d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a15ae9d15a64468f80628ed51c2e42d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a15ae9d15a64468f80628ed51c2e42d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a15ae9d15a64468f80628ed51c2e42d6", "adminURL": "http://10.222.0.64:8080"}]}] May 23 15:49:31.852788 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant: tempest-AttachVolumeNegativeTest-2009285566 May 23 15:49:31.852788 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant-Id: a15ae9d15a64468f80628ed51c2e42d6 May 23 15:49:31.852788 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2009285566 May 23 15:49:31.852788 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User: tempest-AttachVolumeNegativeTest-2009285566-project May 23 15:49:31.852788 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Domain-Id: default May 23 15:49:31.852788 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Domain-Name: Default May 23 15:49:31.852788 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Id: 472049224bbf48699b8a9410ec61aa9e May 23 15:49:31.852788 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Name: tempest-AttachVolumeNegativeTest-2009285566-project May 23 15:49:31.852788 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: method: > May 23 15:49:31.852788 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: exception: Instance aafabce5-30ac-488a-9d85-2d453337bf71 could not be found. May 23 15:49:31.852788 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: action_args: {'id': 'aafabce5-30ac-488a-9d85-2d453337bf71'} May 23 15:49:31.853665 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:49:31.853665 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:49:31.853665 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:49:31.853665 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:49:31.853665 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:49:31.853665 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:49:31.853665 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:49:31.853665 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:49:31.853665 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:49:31.853665 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:49:31.853665 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aafabce5-30ac-488a-9d85-2d453337bf71 could not be found. May 23 15:49:31.853665 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:49:31.853665 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:49:31.853665 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:49:31.853665 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:49:31.853665 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:49:31.853665 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:49:31.853665 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:49:31.853665 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:49:31.853665 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:49:31.855076 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:49:31.855076 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 15:49:31.855076 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 15:49:31.855076 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:49:31.855076 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:49:31.855076 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:49:31.855076 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:49:31.855076 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aafabce5-30ac-488a-9d85-2d453337bf71 could not be found. May 23 15:49:31.855076 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:49:31.855076 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:49:31.855076 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:49:31.855076 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:49:31.855076 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:49:31.855076 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:49:31.855076 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:49:31.855076 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:49:31.855076 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aafabce5-30ac-488a-9d85-2d453337bf71 could not be found. May 23 15:49:31.855076 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:49:31.856674 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-8fb0b23e-2c65-4566-9c41-b4dbd9ba9bee tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Returning 404 to user: Instance aafabce5-30ac-488a-9d85-2d453337bf71 could not be found. {{(pid=124934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:49:31.856674 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-8fb0b23e-2c65-4566-9c41-b4dbd9ba9bee tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/aafabce5-30ac-488a-9d85-2d453337bf71" status: 404 len: 111 microversion: 2.1 time: 0.028875 May 23 15:49:31.856674 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 448/860] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:49:31 2022] GET /compute/v2.1/servers/aafabce5-30ac-488a-9d85-2d453337bf71 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 15:49:33.166321 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-1bc857c2-c26a-466a-8273-3f1a47015aca tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:49:33.166811 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-1bc857c2-c26a-466a-8273-3f1a47015aca tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: ce2cd056-b2f1-43fb-a60a-323039d15162] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:49:33.173615 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1bc857c2-c26a-466a-8273-3f1a47015aca tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:33.174076 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1bc857c2-c26a-466a-8273-3f1a47015aca tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:33.175135 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1bc857c2-c26a-466a-8273-3f1a47015aca tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:33.175575 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1bc857c2-c26a-466a-8273-3f1a47015aca tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:33.191296 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.wsgi [None req-1bc857c2-c26a-466a-8273-3f1a47015aca tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] HTTP exception thrown: Instance ce2cd056-b2f1-43fb-a60a-323039d15162 could not be found. May 23 15:49:33.192872 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-1bc857c2-c26a-466a-8273-3f1a47015aca tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Request method failure captured: May 23 15:49:33.192872 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: request: DELETE /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162 HTTP/1.1 May 23 15:49:33.192872 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Accept: application/json May 23 15:49:33.192872 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Accept-Encoding: identity May 23 15:49:33.192872 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Connection: close May 23 15:49:33.192872 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Content-Length: 0 May 23 15:49:33.192872 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Content-Type: application/json May 23 15:49:33.192872 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Host: 10.222.0.64 May 23 15:49:33.192872 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Openstack-System-Scope: None May 23 15:49:33.192872 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: User-Agent: python-urllib3/1.26.9 May 23 15:49:33.192872 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Auth-Token: gAAAAABii6uOGntB7Pc55mvjpSIsPzNLOlywCYGbr_-Vzy5_quOX_mjNj5PwEdU1U5x_QaGgk51iZzj3S4TZVzOIWCHWkRILSGjcG5ZDd1N2DadGTyYCWvrZ0p61UD6zAV5lw6yOUFVzzVm3KSoYQSF_ZlPFocwbQbQqnGoN6Tr34TmSqfoSNW8 May 23 15:49:33.192872 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Domain-Id: None May 23 15:49:33.192872 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Domain-Name: None May 23 15:49:33.192872 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Identity-Status: Confirmed May 23 15:49:33.192872 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Is-Admin-Project: True May 23 15:49:33.192872 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Domain-Id: default May 23 15:49:33.192872 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Domain-Name: Default May 23 15:49:33.192872 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Id: a15ae9d15a64468f80628ed51c2e42d6 May 23 15:49:33.192872 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Name: tempest-AttachVolumeNegativeTest-2009285566 May 23 15:49:33.192872 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Role: reader,member May 23 15:49:33.192872 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Roles: reader,member May 23 15:49:33.194394 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a15ae9d15a64468f80628ed51c2e42d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a15ae9d15a64468f80628ed51c2e42d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a15ae9d15a64468f80628ed51c2e42d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a15ae9d15a64468f80628ed51c2e42d6", "adminURL": "http://10.222.0.64:8080"}]}] May 23 15:49:33.194394 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant: tempest-AttachVolumeNegativeTest-2009285566 May 23 15:49:33.194394 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant-Id: a15ae9d15a64468f80628ed51c2e42d6 May 23 15:49:33.194394 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2009285566 May 23 15:49:33.194394 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User: tempest-AttachVolumeNegativeTest-2009285566-project May 23 15:49:33.194394 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Domain-Id: default May 23 15:49:33.194394 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Domain-Name: Default May 23 15:49:33.194394 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Id: 472049224bbf48699b8a9410ec61aa9e May 23 15:49:33.194394 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Name: tempest-AttachVolumeNegativeTest-2009285566-project May 23 15:49:33.194394 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: method: > May 23 15:49:33.194394 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: exception: Instance ce2cd056-b2f1-43fb-a60a-323039d15162 could not be found. May 23 15:49:33.194394 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: action_args: {'id': 'ce2cd056-b2f1-43fb-a60a-323039d15162'} May 23 15:49:33.195333 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:49:33.195333 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:49:33.195333 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:49:33.195333 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:49:33.195333 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:49:33.195333 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:49:33.195333 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:49:33.195333 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:49:33.195333 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:49:33.195333 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:49:33.195333 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce2cd056-b2f1-43fb-a60a-323039d15162 could not be found. May 23 15:49:33.195333 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:49:33.195333 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:49:33.195333 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:49:33.195333 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:49:33.195333 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:49:33.195333 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:49:33.195333 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:49:33.195333 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:49:33.195333 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:49:33.196941 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:49:33.196941 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 15:49:33.196941 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 15:49:33.196941 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 15:49:33.196941 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 15:49:33.196941 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:49:33.196941 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:49:33.196941 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:49:33.196941 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:49:33.196941 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce2cd056-b2f1-43fb-a60a-323039d15162 could not be found. May 23 15:49:33.196941 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:49:33.196941 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:49:33.196941 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:49:33.196941 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:49:33.196941 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:49:33.196941 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:49:33.196941 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:49:33.196941 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:49:33.196941 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce2cd056-b2f1-43fb-a60a-323039d15162 could not be found. May 23 15:49:33.196941 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:49:33.198660 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-1bc857c2-c26a-466a-8273-3f1a47015aca tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Returning 404 to user: Instance ce2cd056-b2f1-43fb-a60a-323039d15162 could not be found. {{(pid=124933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:49:33.198660 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-1bc857c2-c26a-466a-8273-3f1a47015aca tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "DELETE /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162" status: 404 len: 111 microversion: 2.1 time: 0.032165 May 23 15:49:33.198660 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 413/861] 10.222.0.64 () {58 vars in 1238 bytes} [Mon May 23 15:49:33 2022] DELETE /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 15:49:33.202570 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-1f4ff4dd-bc10-45f8-ad96-641eb92452c5 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:49:33.203180 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-1f4ff4dd-bc10-45f8-ad96-641eb92452c5 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] [instance: ce2cd056-b2f1-43fb-a60a-323039d15162] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:49:33.210253 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-1f4ff4dd-bc10-45f8-ad96-641eb92452c5 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:33.210704 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-1f4ff4dd-bc10-45f8-ad96-641eb92452c5 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:33.211473 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-1f4ff4dd-bc10-45f8-ad96-641eb92452c5 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:33.211914 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-1f4ff4dd-bc10-45f8-ad96-641eb92452c5 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:33.225608 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.wsgi [None req-1f4ff4dd-bc10-45f8-ad96-641eb92452c5 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] HTTP exception thrown: Instance ce2cd056-b2f1-43fb-a60a-323039d15162 could not be found. May 23 15:49:33.227130 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-1f4ff4dd-bc10-45f8-ad96-641eb92452c5 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Request method failure captured: May 23 15:49:33.227130 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: request: GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162 HTTP/1.1 May 23 15:49:33.227130 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Accept: application/json May 23 15:49:33.227130 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Accept-Encoding: identity May 23 15:49:33.227130 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Connection: close May 23 15:49:33.227130 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Content-Length: 0 May 23 15:49:33.227130 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Content-Type: application/json May 23 15:49:33.227130 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Host: 10.222.0.64 May 23 15:49:33.227130 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Openstack-System-Scope: None May 23 15:49:33.227130 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: User-Agent: python-urllib3/1.26.9 May 23 15:49:33.227130 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Auth-Token: gAAAAABii6uOGntB7Pc55mvjpSIsPzNLOlywCYGbr_-Vzy5_quOX_mjNj5PwEdU1U5x_QaGgk51iZzj3S4TZVzOIWCHWkRILSGjcG5ZDd1N2DadGTyYCWvrZ0p61UD6zAV5lw6yOUFVzzVm3KSoYQSF_ZlPFocwbQbQqnGoN6Tr34TmSqfoSNW8 May 23 15:49:33.227130 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Domain-Id: None May 23 15:49:33.227130 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Domain-Name: None May 23 15:49:33.227130 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Identity-Status: Confirmed May 23 15:49:33.227130 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Is-Admin-Project: True May 23 15:49:33.227130 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Domain-Id: default May 23 15:49:33.227130 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Domain-Name: Default May 23 15:49:33.227130 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Id: a15ae9d15a64468f80628ed51c2e42d6 May 23 15:49:33.227130 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Name: tempest-AttachVolumeNegativeTest-2009285566 May 23 15:49:33.227130 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Role: reader,member May 23 15:49:33.227130 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Roles: reader,member May 23 15:49:33.228796 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a15ae9d15a64468f80628ed51c2e42d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a15ae9d15a64468f80628ed51c2e42d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a15ae9d15a64468f80628ed51c2e42d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a15ae9d15a64468f80628ed51c2e42d6", "adminURL": "http://10.222.0.64:8080"}]}] May 23 15:49:33.228796 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant: tempest-AttachVolumeNegativeTest-2009285566 May 23 15:49:33.228796 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant-Id: a15ae9d15a64468f80628ed51c2e42d6 May 23 15:49:33.228796 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2009285566 May 23 15:49:33.228796 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User: tempest-AttachVolumeNegativeTest-2009285566-project May 23 15:49:33.228796 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Domain-Id: default May 23 15:49:33.228796 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Domain-Name: Default May 23 15:49:33.228796 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Id: 472049224bbf48699b8a9410ec61aa9e May 23 15:49:33.228796 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Name: tempest-AttachVolumeNegativeTest-2009285566-project May 23 15:49:33.228796 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: method: > May 23 15:49:33.228796 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: exception: Instance ce2cd056-b2f1-43fb-a60a-323039d15162 could not be found. May 23 15:49:33.228796 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: action_args: {'id': 'ce2cd056-b2f1-43fb-a60a-323039d15162'} May 23 15:49:33.229960 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:49:33.229960 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:49:33.229960 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:49:33.229960 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:49:33.229960 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:49:33.229960 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:49:33.229960 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:49:33.229960 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:49:33.229960 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:49:33.229960 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:49:33.229960 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce2cd056-b2f1-43fb-a60a-323039d15162 could not be found. May 23 15:49:33.229960 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:49:33.229960 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:49:33.229960 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:49:33.229960 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:49:33.229960 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:49:33.229960 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:49:33.229960 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:49:33.229960 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:49:33.229960 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:49:33.231458 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:49:33.231458 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 15:49:33.231458 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 15:49:33.231458 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:49:33.231458 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:49:33.231458 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:49:33.231458 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:49:33.231458 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce2cd056-b2f1-43fb-a60a-323039d15162 could not be found. May 23 15:49:33.231458 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:49:33.231458 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:49:33.231458 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:49:33.231458 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:49:33.231458 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:49:33.231458 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:49:33.231458 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:49:33.231458 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:49:33.231458 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce2cd056-b2f1-43fb-a60a-323039d15162 could not be found. May 23 15:49:33.231458 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:49:33.232946 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-1f4ff4dd-bc10-45f8-ad96-641eb92452c5 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] Returning 404 to user: Instance ce2cd056-b2f1-43fb-a60a-323039d15162 could not be found. {{(pid=124934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:49:33.232946 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-1f4ff4dd-bc10-45f8-ad96-641eb92452c5 tempest-AttachVolumeNegativeTest-2009285566 tempest-AttachVolumeNegativeTest-2009285566-project] 10.222.0.64 "GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162" status: 404 len: 111 microversion: 2.1 time: 0.029693 May 23 15:49:33.232946 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 449/862] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:49:33 2022] GET /compute/v2.1/servers/ce2cd056-b2f1-43fb-a60a-323039d15162 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 15:49:39.336264 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-631c111c-3643-4c8a-aa6c-463ef16f1ff6 tempest-VolumesGetTestJSON-1771924610 tempest-VolumesGetTestJSON-1771924610-project] Action: 'create', calling method: .version_select at 0x7fab51dd9dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-632632451", "metadata": {"Type": "work"}}} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:49:39.919508 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-631c111c-3643-4c8a-aa6c-463ef16f1ff6 tempest-VolumesGetTestJSON-1771924610 tempest-VolumesGetTestJSON-1771924610-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.704189 May 23 15:49:39.920149 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 414/863] 10.222.0.64 () {60 vars in 1155 bytes} [Mon May 23 15:49:39 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 705 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 23 15:49:39.931190 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-bdc46940-0a4e-4fcf-99a1-6f79b8f49e0b tempest-VolumesGetTestJSON-1771924610 tempest-VolumesGetTestJSON-1771924610-project] Calling method '.version_select at 0x7fab570e1b80>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:49:39.984601 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-bdc46940-0a4e-4fcf-99a1-6f79b8f49e0b tempest-VolumesGetTestJSON-1771924610 tempest-VolumesGetTestJSON-1771924610-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/ab34d219-3163-45d2-b5a9-c218a11ceacc" status: 200 len: 352 microversion: 2.1 time: 0.057123 May 23 15:49:39.985614 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 450/864] 10.222.0.64 () {58 vars in 1244 bytes} [Mon May 23 15:49:39 2022] GET /compute/v2.1/os-volumes/ab34d219-3163-45d2-b5a9-c218a11ceacc => generated 352 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:49:40.997952 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-4cad98d9-7d8c-4ff6-b784-fe66bde0141d tempest-VolumesGetTestJSON-1771924610 tempest-VolumesGetTestJSON-1771924610-project] Calling method '.version_select at 0x7fab51da04c0>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:49:41.043637 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-4cad98d9-7d8c-4ff6-b784-fe66bde0141d tempest-VolumesGetTestJSON-1771924610 tempest-VolumesGetTestJSON-1771924610-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/ab34d219-3163-45d2-b5a9-c218a11ceacc" status: 200 len: 353 microversion: 2.1 time: 0.050043 May 23 15:49:41.044228 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 415/865] 10.222.0.64 () {58 vars in 1244 bytes} [Mon May 23 15:49:40 2022] GET /compute/v2.1/os-volumes/ab34d219-3163-45d2-b5a9-c218a11ceacc => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:49:41.056957 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-4a3c90fd-df09-44a4-a194-adb7fccbfc61 tempest-VolumesGetTestJSON-1771924610 tempest-VolumesGetTestJSON-1771924610-project] Calling method '.version_select at 0x7fab51f90dc0>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:49:41.104504 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-4a3c90fd-df09-44a4-a194-adb7fccbfc61 tempest-VolumesGetTestJSON-1771924610 tempest-VolumesGetTestJSON-1771924610-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/ab34d219-3163-45d2-b5a9-c218a11ceacc" status: 200 len: 353 microversion: 2.1 time: 0.052249 May 23 15:49:41.105182 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 451/866] 10.222.0.64 () {58 vars in 1244 bytes} [Mon May 23 15:49:41 2022] GET /compute/v2.1/os-volumes/ab34d219-3163-45d2-b5a9-c218a11ceacc => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:49:41.117149 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-27d9c1a2-cf7f-47b6-89b4-7d288e48288d tempest-VolumesGetTestJSON-1771924610 tempest-VolumesGetTestJSON-1771924610-project] Calling method '.version_select at 0x7fab51da48b0>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:49:41.347199 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-27d9c1a2-cf7f-47b6-89b4-7d288e48288d tempest-VolumesGetTestJSON-1771924610 tempest-VolumesGetTestJSON-1771924610-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/ab34d219-3163-45d2-b5a9-c218a11ceacc" status: 202 len: 0 microversion: 2.1 time: 0.234538 May 23 15:49:41.349608 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 416/867] 10.222.0.64 () {58 vars in 1247 bytes} [Mon May 23 15:49:41 2022] DELETE /compute/v2.1/os-volumes/ab34d219-3163-45d2-b5a9-c218a11ceacc => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 15:49:41.356130 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-b75c85c0-d1cf-45f0-820b-37869551ad20 tempest-VolumesGetTestJSON-1771924610 tempest-VolumesGetTestJSON-1771924610-project] Calling method '.version_select at 0x7fab57135e50>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:49:41.403678 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-b75c85c0-d1cf-45f0-820b-37869551ad20 tempest-VolumesGetTestJSON-1771924610 tempest-VolumesGetTestJSON-1771924610-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/ab34d219-3163-45d2-b5a9-c218a11ceacc" status: 200 len: 352 microversion: 2.1 time: 0.051242 May 23 15:49:41.404541 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 452/868] 10.222.0.64 () {58 vars in 1244 bytes} [Mon May 23 15:49:41 2022] GET /compute/v2.1/os-volumes/ab34d219-3163-45d2-b5a9-c218a11ceacc => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:49:42.417311 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-ba936fb1-249c-471f-b926-c7a8ac31c882 tempest-VolumesGetTestJSON-1771924610 tempest-VolumesGetTestJSON-1771924610-project] Calling method '.version_select at 0x7fab51dd2af0>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:49:42.444324 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.wsgi [None req-ba936fb1-249c-471f-b926-c7a8ac31c882 tempest-VolumesGetTestJSON-1771924610 tempest-VolumesGetTestJSON-1771924610-project] HTTP exception thrown: Volume ab34d219-3163-45d2-b5a9-c218a11ceacc could not be found. May 23 15:49:42.446256 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-ba936fb1-249c-471f-b926-c7a8ac31c882 tempest-VolumesGetTestJSON-1771924610 tempest-VolumesGetTestJSON-1771924610-project] Request method failure captured: May 23 15:49:42.446256 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: request: GET /compute/v2.1/os-volumes/ab34d219-3163-45d2-b5a9-c218a11ceacc HTTP/1.1 May 23 15:49:42.446256 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Accept: application/json May 23 15:49:42.446256 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Accept-Encoding: identity May 23 15:49:42.446256 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Connection: close May 23 15:49:42.446256 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Content-Length: 0 May 23 15:49:42.446256 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Content-Type: application/json May 23 15:49:42.446256 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Host: 10.222.0.64 May 23 15:49:42.446256 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Openstack-System-Scope: None May 23 15:49:42.446256 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: User-Agent: python-urllib3/1.26.9 May 23 15:49:42.446256 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Auth-Token: gAAAAABii60T56IOrndrEmGnHE1xG7OwQxTIsLKGbU12twYY8qtcXGbUlZEJXoNWJLoZzYhJgYeP-Yckoe95anUnHfrfQQiWeuiPgFlvD-hPMSQGR7Pxtqcl9DgRAG6yZG2CuhwsnDf77kF8sBjqlxho7NIUHXI5QZSqXagSF8or2n_GCgHHBzg May 23 15:49:42.446256 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Domain-Id: None May 23 15:49:42.446256 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Domain-Name: None May 23 15:49:42.446256 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Identity-Status: Confirmed May 23 15:49:42.446256 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Is-Admin-Project: True May 23 15:49:42.446256 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Domain-Id: default May 23 15:49:42.446256 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Domain-Name: Default May 23 15:49:42.446256 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Id: afcda3ba1e7e4a8cb7a6f5cda10e2ac2 May 23 15:49:42.446256 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Name: tempest-VolumesGetTestJSON-1771924610 May 23 15:49:42.446256 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Role: reader,member May 23 15:49:42.446256 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Roles: reader,member May 23 15:49:42.447929 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/afcda3ba1e7e4a8cb7a6f5cda10e2ac2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/afcda3ba1e7e4a8cb7a6f5cda10e2ac2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/afcda3ba1e7e4a8cb7a6f5cda10e2ac2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_afcda3ba1e7e4a8cb7a6f5cda10e2ac2", "adminURL": "http://10.222.0.64:8080"}]}] May 23 15:49:42.447929 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant: tempest-VolumesGetTestJSON-1771924610 May 23 15:49:42.447929 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant-Id: afcda3ba1e7e4a8cb7a6f5cda10e2ac2 May 23 15:49:42.447929 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant-Name: tempest-VolumesGetTestJSON-1771924610 May 23 15:49:42.447929 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User: tempest-VolumesGetTestJSON-1771924610-project May 23 15:49:42.447929 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Domain-Id: default May 23 15:49:42.447929 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Domain-Name: Default May 23 15:49:42.447929 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Id: 4f720cc98ea242279b7c560ae0205efd May 23 15:49:42.447929 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Name: tempest-VolumesGetTestJSON-1771924610-project May 23 15:49:42.447929 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: method: May 23 15:49:42.447929 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: exception: Volume ab34d219-3163-45d2-b5a9-c218a11ceacc could not be found. May 23 15:49:42.447929 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: action_args: {'id': 'ab34d219-3163-45d2-b5a9-c218a11ceacc'} May 23 15:49:42.447929 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:49:42.449016 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:49:42.449016 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 15:49:42.449016 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 15:49:42.449016 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 15:49:42.449016 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 15:49:42.449016 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 15:49:42.449016 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 15:49:42.449016 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 15:49:42.449016 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 15:49:42.449016 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 15:49:42.449016 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 15:49:42.449016 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 15:49:42.449016 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 15:49:42.449016 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 15:49:42.449016 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 15:49:42.449016 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ab34d219-3163-45d2-b5a9-c218a11ceacc could not be found. (HTTP 404) (Request-ID: req-964ff43e-e223-4647-b63e-3aaedf6796f2) May 23 15:49:42.449016 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:49:42.449016 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:49:42.449016 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:49:42.450587 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:49:42.450587 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 23 15:49:42.450587 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 23 15:49:42.450587 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 15:49:42.450587 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 15:49:42.450587 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 23 15:49:42.450587 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 23 15:49:42.450587 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 15:49:42.450587 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 15:49:42.450587 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 15:49:42.450587 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 15:49:42.450587 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 15:49:42.450587 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 15:49:42.450587 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 15:49:42.450587 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 15:49:42.450587 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 15:49:42.450587 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 15:49:42.450587 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 15:49:42.450587 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 15:49:42.451974 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 15:49:42.451974 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 15:49:42.451974 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 15:49:42.451974 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 15:49:42.451974 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ab34d219-3163-45d2-b5a9-c218a11ceacc could not be found. May 23 15:49:42.451974 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:49:42.451974 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:49:42.451974 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:49:42.451974 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:49:42.451974 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:49:42.451974 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:49:42.451974 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:49:42.451974 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:49:42.451974 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 15:49:42.451974 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 15:49:42.451974 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:49:42.451974 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:49:42.451974 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 23 15:49:42.451974 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:49:42.453465 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ab34d219-3163-45d2-b5a9-c218a11ceacc could not be found. May 23 15:49:42.453465 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:49:42.453465 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:49:42.453465 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:49:42.453465 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:49:42.453465 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:49:42.453465 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:49:42.453465 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:49:42.453465 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:49:42.453465 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ab34d219-3163-45d2-b5a9-c218a11ceacc could not be found. May 23 15:49:42.453465 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:49:42.453465 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-ba936fb1-249c-471f-b926-c7a8ac31c882 tempest-VolumesGetTestJSON-1771924610 tempest-VolumesGetTestJSON-1771924610-project] Returning 404 to user: Volume ab34d219-3163-45d2-b5a9-c218a11ceacc could not be found. {{(pid=124933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:49:42.453465 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-ba936fb1-249c-471f-b926-c7a8ac31c882 tempest-VolumesGetTestJSON-1771924610 tempest-VolumesGetTestJSON-1771924610-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/ab34d219-3163-45d2-b5a9-c218a11ceacc" status: 404 len: 109 microversion: 2.1 time: 0.034665 May 23 15:49:42.453465 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 417/869] 10.222.0.64 () {58 vars in 1244 bytes} [Mon May 23 15:49:42 2022] GET /compute/v2.1/os-volumes/ab34d219-3163-45d2-b5a9-c218a11ceacc => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 15:49:46.325814 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:49:46.326564 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_cell1:SELECT=18 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:49:46.330311 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-3cd3e3bc-a1ed-4c50-99fa-3dfc08f31f06 tempest-VolumesTestJSON-417884244 tempest-VolumesTestJSON-417884244-project] Calling method '.version_select at 0x7fab51eb5940>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:49:46.379311 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-3cd3e3bc-a1ed-4c50-99fa-3dfc08f31f06 tempest-VolumesTestJSON-417884244 tempest-VolumesTestJSON-417884244-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/2fbd9a93-0e66-408b-8aba-9bb1d706c6b3" status: 200 len: 349 microversion: 2.1 time: 0.054986 May 23 15:49:46.380522 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 453/870] 10.222.0.64 () {58 vars in 1244 bytes} [Mon May 23 15:49:46 2022] GET /compute/v2.1/os-volumes/2fbd9a93-0e66-408b-8aba-9bb1d706c6b3 => generated 349 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:49:48.013983 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:49:48.014802 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=94,nova_cell1:INSERT=2 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:49:48.019619 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-e12fc9e3-bc7c-4803-8f61-65486606cae4 tempest-VolumesTestJSON-417884244 tempest-VolumesTestJSON-417884244-project] Calling method '.version_select at 0x7fab51da04c0>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:49:48.066499 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-e12fc9e3-bc7c-4803-8f61-65486606cae4 tempest-VolumesTestJSON-417884244 tempest-VolumesTestJSON-417884244-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/2d1833d7-e81e-4804-b774-29ccff8f56e3" status: 200 len: 350 microversion: 2.1 time: 0.053497 May 23 15:49:48.067635 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 418/871] 10.222.0.64 () {58 vars in 1244 bytes} [Mon May 23 15:49:48 2022] GET /compute/v2.1/os-volumes/2d1833d7-e81e-4804-b774-29ccff8f56e3 => generated 350 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:49:49.827261 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-5158e1de-fb80-432d-ae7e-79221ebe4d62 tempest-VolumesTestJSON-417884244 tempest-VolumesTestJSON-417884244-project] Calling method '.version_select at 0x7fab57135160>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:49:49.875287 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-5158e1de-fb80-432d-ae7e-79221ebe4d62 tempest-VolumesTestJSON-417884244 tempest-VolumesTestJSON-417884244-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/d59caa16-22c8-4ed0-a683-ea231b31c61f" status: 200 len: 350 microversion: 2.1 time: 0.052634 May 23 15:49:49.875873 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 454/872] 10.222.0.64 () {58 vars in 1244 bytes} [Mon May 23 15:49:49 2022] GET /compute/v2.1/os-volumes/d59caa16-22c8-4ed0-a683-ea231b31c61f => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:49:49.891298 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-b4370dc1-3768-46eb-b3c8-764f8b45d37d tempest-VolumesTestJSON-417884244 tempest-VolumesTestJSON-417884244-project] Calling method '.version_select at 0x7fab51dd9ee0>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:49:49.970983 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-b4370dc1-3768-46eb-b3c8-764f8b45d37d tempest-VolumesTestJSON-417884244 tempest-VolumesTestJSON-417884244-project] 10.222.0.64 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.084343 May 23 15:49:49.971555 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 419/873] 10.222.0.64 () {58 vars in 1133 bytes} [Mon May 23 15:49:49 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:49:49.984220 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-a371d9df-018f-41fe-a8de-bee9f4be7810 tempest-VolumesTestJSON-417884244 tempest-VolumesTestJSON-417884244-project] Calling method '.version_select at 0x7fab51f90f70>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:49:50.065190 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-a371d9df-018f-41fe-a8de-bee9f4be7810 tempest-VolumesTestJSON-417884244 tempest-VolumesTestJSON-417884244-project] 10.222.0.64 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.084516 May 23 15:49:50.065787 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 455/874] 10.222.0.64 () {58 vars in 1148 bytes} [Mon May 23 15:49:49 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:49:50.077897 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-6e261da1-ae9d-4e33-8e10-242cff4f089d tempest-VolumesTestJSON-417884244 tempest-VolumesTestJSON-417884244-project] Calling method '.version_select at 0x7fab51da45e0>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:49:50.160467 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-6e261da1-ae9d-4e33-8e10-242cff4f089d tempest-VolumesTestJSON-417884244 tempest-VolumesTestJSON-417884244-project] 10.222.0.64 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.086991 May 23 15:49:50.161832 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 420/875] 10.222.0.64 () {58 vars in 1133 bytes} [Mon May 23 15:49:50 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:49:50.172648 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-2401f2ff-897b-474e-992c-b6c250aaf4aa tempest-VolumesTestJSON-417884244 tempest-VolumesTestJSON-417884244-project] Calling method '.version_select at 0x7fab570f53a0>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:49:50.254819 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-2401f2ff-897b-474e-992c-b6c250aaf4aa tempest-VolumesTestJSON-417884244 tempest-VolumesTestJSON-417884244-project] 10.222.0.64 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.083902 May 23 15:49:50.254819 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 456/876] 10.222.0.64 () {58 vars in 1166 bytes} [Mon May 23 15:49:50 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:49:50.264809 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-5e9e4f82-ac56-49f8-a900-09a930f5c717 tempest-VolumesTestJSON-417884244 tempest-VolumesTestJSON-417884244-project] Calling method '.version_select at 0x7fab51db2ee0>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:49:50.345187 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-5e9e4f82-ac56-49f8-a900-09a930f5c717 tempest-VolumesTestJSON-417884244 tempest-VolumesTestJSON-417884244-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.084025 May 23 15:49:50.345826 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 421/877] 10.222.0.64 () {58 vars in 1169 bytes} [Mon May 23 15:49:50 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:49:50.358161 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-a4d3b237-ac42-42b1-aec5-e296d6ff23cf tempest-VolumesTestJSON-417884244 tempest-VolumesTestJSON-417884244-project] Calling method '.version_select at 0x7fab51eb5940>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:49:50.440069 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-a4d3b237-ac42-42b1-aec5-e296d6ff23cf tempest-VolumesTestJSON-417884244 tempest-VolumesTestJSON-417884244-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.085619 May 23 15:49:50.440641 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 457/878] 10.222.0.64 () {58 vars in 1154 bytes} [Mon May 23 15:49:50 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:49:50.457148 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-3d9f030e-7aeb-4a79-8102-cc77e7b895a4 tempest-VolumesTestJSON-417884244 tempest-VolumesTestJSON-417884244-project] Calling method '.version_select at 0x7fab51da4940>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:49:50.538479 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-3d9f030e-7aeb-4a79-8102-cc77e7b895a4 tempest-VolumesTestJSON-417884244 tempest-VolumesTestJSON-417884244-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.085078 May 23 15:49:50.539037 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 422/879] 10.222.0.64 () {58 vars in 1187 bytes} [Mon May 23 15:49:50 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:49:50.550848 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-8350786a-b60f-4bc7-ad5b-6b8668decd2c tempest-VolumesTestJSON-417884244 tempest-VolumesTestJSON-417884244-project] Calling method '.version_select at 0x7fab570e18b0>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:49:50.635517 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-8350786a-b60f-4bc7-ad5b-6b8668decd2c tempest-VolumesTestJSON-417884244 tempest-VolumesTestJSON-417884244-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.088195 May 23 15:49:50.635778 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 458/880] 10.222.0.64 () {58 vars in 1154 bytes} [Mon May 23 15:49:50 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:49:55.632362 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-144b8f72-6789-414a-901d-41c710a5a9fe tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-314930971", "imageRef": "a5c8503f-3733-426f-8a5b-c7c9358e4a45", "flavorRef": "452", "networks": [{"uuid": "463d1c0a-9c63-4f99-9c4a-599a01360208"}]}} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:49:55.687009 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.network.neutron [None req-144b8f72-6789-414a-901d-41c710a5a9fe tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] validate_networks() for [('463d1c0a-9c63-4f99-9c4a-599a01360208', None, None, None, None, None)] {{(pid=124933) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 15:49:56.045442 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.virt.hardware [None req-144b8f72-6789-414a-901d-41c710a5a9fe tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Flavor limits 0:0:0 {{(pid=124933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 15:49:56.045865 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.virt.hardware [None req-144b8f72-6789-414a-901d-41c710a5a9fe tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Image limits 0:0:0 {{(pid=124933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 15:49:56.046371 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.virt.hardware [None req-144b8f72-6789-414a-901d-41c710a5a9fe tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Flavor pref 0:0:0 {{(pid=124933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 15:49:56.046778 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.virt.hardware [None req-144b8f72-6789-414a-901d-41c710a5a9fe tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Image pref 0:0:0 {{(pid=124933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 15:49:56.047222 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.virt.hardware [None req-144b8f72-6789-414a-901d-41c710a5a9fe tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 15:49:56.056857 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-144b8f72-6789-414a-901d-41c710a5a9fe tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:56.057327 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-144b8f72-6789-414a-901d-41c710a5a9fe tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:56.058117 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-144b8f72-6789-414a-901d-41c710a5a9fe tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:56.058546 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-144b8f72-6789-414a-901d-41c710a5a9fe tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:56.074533 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.quota [None req-144b8f72-6789-414a-901d-41c710a5a9fe tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Getting quotas for project 58c0e4fa5fa246f08bb61703a42e2c59. Resources: {'ram', 'instances', 'cores'} {{(pid=124933) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 15:49:56.078743 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.quota [None req-144b8f72-6789-414a-901d-41c710a5a9fe tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Getting quotas for user 6c14e93cced14b1b95e2de8fedce31e8 and project 58c0e4fa5fa246f08bb61703a42e2c59. Resources: {'ram', 'instances', 'cores'} {{(pid=124933) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 15:49:56.089673 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-144b8f72-6789-414a-901d-41c710a5a9fe tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Going to run 1 instances... {{(pid=124933) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 15:49:56.091898 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-144b8f72-6789-414a-901d-41c710a5a9fe tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] [instance: ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5c8503f-3733-426f-8a5b-c7c9358e4a45',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124933) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 15:49:56.172710 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-144b8f72-6789-414a-901d-41c710a5a9fe tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.544744 May 23 15:49:56.173416 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 423/881] 10.222.0.64 () {60 vars in 1146 bytes} [Mon May 23 15:49:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 546 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 15:49:56.185990 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-c9bc0e56-36ad-40a2-a3a5-8a1b5b8d50fe tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:49:56.187930 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-c9bc0e56-36ad-40a2-a3a5-8a1b5b8d50fe tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] [instance: ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:49:56.243914 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-c9bc0e56-36ad-40a2-a3a5-8a1b5b8d50fe tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c14e93cced14b1b95e2de8fedce31e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c0e4fa5fa246f08bb61703a42e2c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:49:56.250717 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-c9bc0e56-36ad-40a2-a3a5-8a1b5b8d50fe tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] 10.222.0.64 "GET /compute/v2.1/servers/ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e" status: 200 len: 1218 microversion: 2.1 time: 0.069074 May 23 15:49:56.251319 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 459/882] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:49:56 2022] GET /compute/v2.1/servers/ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e => generated 1218 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:49:57.267678 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-466234f9-876b-4bd1-9251-c47a415431c1 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:49:57.268295 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-466234f9-876b-4bd1-9251-c47a415431c1 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] [instance: ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:49:57.275773 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-466234f9-876b-4bd1-9251-c47a415431c1 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:57.276180 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-466234f9-876b-4bd1-9251-c47a415431c1 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:57.277678 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-466234f9-876b-4bd1-9251-c47a415431c1 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:57.278129 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-466234f9-876b-4bd1-9251-c47a415431c1 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:57.341533 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-466234f9-876b-4bd1-9251-c47a415431c1 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c14e93cced14b1b95e2de8fedce31e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c0e4fa5fa246f08bb61703a42e2c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:49:57.350524 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-466234f9-876b-4bd1-9251-c47a415431c1 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] 10.222.0.64 "GET /compute/v2.1/servers/ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e" status: 200 len: 1222 microversion: 2.1 time: 0.087325 May 23 15:49:57.351083 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 424/883] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:49:57 2022] GET /compute/v2.1/servers/ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e => generated 1222 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:49:58.368436 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-e28079f2-9635-4182-aad6-3c6e9a114151 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:49:58.369084 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-e28079f2-9635-4182-aad6-3c6e9a114151 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] [instance: ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:49:58.376065 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e28079f2-9635-4182-aad6-3c6e9a114151 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:58.376795 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e28079f2-9635-4182-aad6-3c6e9a114151 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:58.378211 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e28079f2-9635-4182-aad6-3c6e9a114151 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:58.378211 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e28079f2-9635-4182-aad6-3c6e9a114151 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:58.443817 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-e28079f2-9635-4182-aad6-3c6e9a114151 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c14e93cced14b1b95e2de8fedce31e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c0e4fa5fa246f08bb61703a42e2c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:49:58.451308 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-e28079f2-9635-4182-aad6-3c6e9a114151 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] 10.222.0.64 "GET /compute/v2.1/servers/ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e" status: 200 len: 1270 microversion: 2.1 time: 0.087774 May 23 15:49:58.451882 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 460/884] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:49:58 2022] GET /compute/v2.1/servers/ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e => generated 1270 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:49:58.838527 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-45c96a8a-f811-4f27-be17-534dca06df0f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:49:58.839059 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-45c96a8a-f811-4f27-be17-534dca06df0f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:49:58.845453 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-45c96a8a-f811-4f27-be17-534dca06df0f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:58.846021 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-45c96a8a-f811-4f27-be17-534dca06df0f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:58.847220 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-45c96a8a-f811-4f27-be17-534dca06df0f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:58.848327 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-45c96a8a-f811-4f27-be17-534dca06df0f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:58.879085 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-45c96a8a-f811-4f27-be17-534dca06df0f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3/os-volume_attachments/d92e89fc-5971-4678-88f9-b578a4146f98" status: 200 len: 194 microversion: 2.20 time: 0.054876 May 23 15:49:58.879785 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 425/885] 10.222.0.64 () {60 vars in 1453 bytes} [Mon May 23 15:49:58 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3/os-volume_attachments/d92e89fc-5971-4678-88f9-b578a4146f98 => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 15:49:58.945129 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-af4eef37-1231-408d-b2cb-6ca07bcf44cc tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:49:58.945621 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-af4eef37-1231-408d-b2cb-6ca07bcf44cc tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:49:58.951637 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-af4eef37-1231-408d-b2cb-6ca07bcf44cc tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:58.952093 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-af4eef37-1231-408d-b2cb-6ca07bcf44cc tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:58.953039 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-af4eef37-1231-408d-b2cb-6ca07bcf44cc tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:58.953503 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-af4eef37-1231-408d-b2cb-6ca07bcf44cc tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:59.033339 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.objects.instance [None req-af4eef37-1231-408d-b2cb-6ca07bcf44cc tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lazy-loading 'services' on Instance uuid 9d9a9391-45aa-4e87-b025-839d2bf5c8a3 {{(pid=124934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 15:49:59.281681 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-af4eef37-1231-408d-b2cb-6ca07bcf44cc tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "DELETE /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3/os-volume_attachments/d92e89fc-5971-4678-88f9-b578a4146f98" status: 202 len: 0 microversion: 2.20 time: 0.339085 May 23 15:49:59.281681 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 461/886] 10.222.0.64 () {60 vars in 1456 bytes} [Mon May 23 15:49:58 2022] DELETE /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3/os-volume_attachments/d92e89fc-5971-4678-88f9-b578a4146f98 => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 23 15:49:59.293430 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-16e04bdc-02d5-4cac-b590-86bd051b92df tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:49:59.294585 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-16e04bdc-02d5-4cac-b590-86bd051b92df tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:49:59.302607 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-16e04bdc-02d5-4cac-b590-86bd051b92df tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:59.303233 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-16e04bdc-02d5-4cac-b590-86bd051b92df tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:59.304252 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-16e04bdc-02d5-4cac-b590-86bd051b92df tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:59.304805 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-16e04bdc-02d5-4cac-b590-86bd051b92df tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:59.341624 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-16e04bdc-02d5-4cac-b590-86bd051b92df tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050515 May 23 15:49:59.341624 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 426/887] 10.222.0.64 () {60 vars in 1342 bytes} [Mon May 23 15:49:59 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 15:49:59.468942 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-5e9a53f0-e1f1-42ce-a1a7-1cc5ef3be46b tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:49:59.469678 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-5e9a53f0-e1f1-42ce-a1a7-1cc5ef3be46b tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] [instance: ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:49:59.476620 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5e9a53f0-e1f1-42ce-a1a7-1cc5ef3be46b tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:59.477098 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5e9a53f0-e1f1-42ce-a1a7-1cc5ef3be46b tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:59.477869 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5e9a53f0-e1f1-42ce-a1a7-1cc5ef3be46b tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:49:59.478333 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5e9a53f0-e1f1-42ce-a1a7-1cc5ef3be46b tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:49:59.613148 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-5e9a53f0-e1f1-42ce-a1a7-1cc5ef3be46b tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c14e93cced14b1b95e2de8fedce31e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c0e4fa5fa246f08bb61703a42e2c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:49:59.621027 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-5e9a53f0-e1f1-42ce-a1a7-1cc5ef3be46b tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] 10.222.0.64 "GET /compute/v2.1/servers/ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e" status: 200 len: 1318 microversion: 2.1 time: 0.156652 May 23 15:49:59.621613 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 462/888] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:49:59 2022] GET /compute/v2.1/servers/ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:50:00.355479 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-9e6b2f3a-376e-41b4-8185-05d2148467b7 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:50:00.356401 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-9e6b2f3a-376e-41b4-8185-05d2148467b7 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:50:00.363249 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-9e6b2f3a-376e-41b4-8185-05d2148467b7 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:00.364087 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-9e6b2f3a-376e-41b4-8185-05d2148467b7 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:00.365690 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-9e6b2f3a-376e-41b4-8185-05d2148467b7 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:00.366288 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-9e6b2f3a-376e-41b4-8185-05d2148467b7 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:00.398374 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-9e6b2f3a-376e-41b4-8185-05d2148467b7 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046854 May 23 15:50:00.398932 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 427/889] 10.222.0.64 () {60 vars in 1342 bytes} [Mon May 23 15:50:00 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 15:50:00.641186 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-4a214861-4d0b-4548-97f2-16b2d0fb1ba3 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:50:00.641902 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-4a214861-4d0b-4548-97f2-16b2d0fb1ba3 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] [instance: ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:50:00.649673 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4a214861-4d0b-4548-97f2-16b2d0fb1ba3 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:00.650483 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4a214861-4d0b-4548-97f2-16b2d0fb1ba3 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:00.651278 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4a214861-4d0b-4548-97f2-16b2d0fb1ba3 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:00.651729 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4a214861-4d0b-4548-97f2-16b2d0fb1ba3 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:00.654847 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [req-2f940a66-d6bb-4f2e-a168-42bfb5bf7bcb req-2404730c-b0c7-4e5b-99fb-f006c36566b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e", "tag": "e4eaecf3-0ea6-488b-9f92-86de045b6736"}]} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:50:00.673865 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-2f940a66-d6bb-4f2e-a168-42bfb5bf7bcb req-2404730c-b0c7-4e5b-99fb-f006c36566b4 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:00.674333 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-2f940a66-d6bb-4f2e-a168-42bfb5bf7bcb req-2404730c-b0c7-4e5b-99fb-f006c36566b4 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:00.692464 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.compute.server_external_events [req-2f940a66-d6bb-4f2e-a168-42bfb5bf7bcb req-2404730c-b0c7-4e5b-99fb-f006c36566b4 service nova] Creating event network-changed:e4eaecf3-0ea6-488b-9f92-86de045b6736 for instance ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e on hv-cinder-84067 May 23 15:50:00.699677 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [req-2f940a66-d6bb-4f2e-a168-42bfb5bf7bcb req-2404730c-b0c7-4e5b-99fb-f006c36566b4 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048454 May 23 15:50:00.701142 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 428/890] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:50:00.825031 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-4a214861-4d0b-4548-97f2-16b2d0fb1ba3 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c14e93cced14b1b95e2de8fedce31e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c0e4fa5fa246f08bb61703a42e2c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:00.832896 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-4a214861-4d0b-4548-97f2-16b2d0fb1ba3 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] 10.222.0.64 "GET /compute/v2.1/servers/ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e" status: 200 len: 1318 microversion: 2.1 time: 0.195290 May 23 15:50:00.833492 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 463/891] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:50:00 2022] GET /compute/v2.1/servers/ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e => generated 1318 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:50:01.411628 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-c523de7a-2dd9-46a6-a16e-cb3761f52a7c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:50:01.412558 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-c523de7a-2dd9-46a6-a16e-cb3761f52a7c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:50:01.419353 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c523de7a-2dd9-46a6-a16e-cb3761f52a7c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:01.419863 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c523de7a-2dd9-46a6-a16e-cb3761f52a7c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:01.420631 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c523de7a-2dd9-46a6-a16e-cb3761f52a7c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:01.421118 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c523de7a-2dd9-46a6-a16e-cb3761f52a7c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:01.454515 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-c523de7a-2dd9-46a6-a16e-cb3761f52a7c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047837 May 23 15:50:01.455073 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 429/892] 10.222.0.64 () {60 vars in 1342 bytes} [Mon May 23 15:50:01 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:50:01.515394 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-3a2e9526-c766-4c9c-af7d-62cd7062158c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:50:01.515897 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-3a2e9526-c766-4c9c-af7d-62cd7062158c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:50:01.522618 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3a2e9526-c766-4c9c-af7d-62cd7062158c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:01.523073 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3a2e9526-c766-4c9c-af7d-62cd7062158c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:01.523838 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3a2e9526-c766-4c9c-af7d-62cd7062158c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:01.524279 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3a2e9526-c766-4c9c-af7d-62cd7062158c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:01.548797 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-3a2e9526-c766-4c9c-af7d-62cd7062158c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Going to try to terminate instance {{(pid=124934) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 15:50:01.844612 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-3a2e9526-c766-4c9c-af7d-62cd7062158c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "DELETE /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 204 len: 0 microversion: 2.20 time: 0.332789 May 23 15:50:01.845319 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 464/893] 10.222.0.64 () {60 vars in 1279 bytes} [Mon May 23 15:50:01 2022] DELETE /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 23 15:50:01.850082 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-788f3edf-13a5-41c5-a736-d460d1ba6169 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:50:01.853739 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-788f3edf-13a5-41c5-a736-d460d1ba6169 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] [instance: ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:50:01.854707 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-66c9dcf6-efe8-4cd7-800d-0430fc3e7154 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:50:01.855515 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-66c9dcf6-efe8-4cd7-800d-0430fc3e7154 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:50:01.856658 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-788f3edf-13a5-41c5-a736-d460d1ba6169 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:01.857161 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-788f3edf-13a5-41c5-a736-d460d1ba6169 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:01.857945 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-788f3edf-13a5-41c5-a736-d460d1ba6169 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:01.858391 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-788f3edf-13a5-41c5-a736-d460d1ba6169 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:01.862041 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-66c9dcf6-efe8-4cd7-800d-0430fc3e7154 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:01.862490 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-66c9dcf6-efe8-4cd7-800d-0430fc3e7154 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:01.863256 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-66c9dcf6-efe8-4cd7-800d-0430fc3e7154 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:01.864291 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-66c9dcf6-efe8-4cd7-800d-0430fc3e7154 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:02.055735 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-788f3edf-13a5-41c5-a736-d460d1ba6169 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c14e93cced14b1b95e2de8fedce31e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c0e4fa5fa246f08bb61703a42e2c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:02.058965 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-66c9dcf6-efe8-4cd7-800d-0430fc3e7154 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:02.063432 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-788f3edf-13a5-41c5-a736-d460d1ba6169 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] 10.222.0.64 "GET /compute/v2.1/servers/ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e" status: 200 len: 1318 microversion: 2.1 time: 0.218320 May 23 15:50:02.063972 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 430/894] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:50:01 2022] GET /compute/v2.1/servers/ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e => generated 1318 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:50:02.067518 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-66c9dcf6-efe8-4cd7-800d-0430fc3e7154 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:02.069018 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-66c9dcf6-efe8-4cd7-800d-0430fc3e7154 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:02.070181 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-66c9dcf6-efe8-4cd7-800d-0430fc3e7154 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 200 len: 1723 microversion: 2.20 time: 0.219777 May 23 15:50:02.070711 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 465/895] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:50:01 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 1723 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 15:50:03.080424 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-15ac4b8b-bf40-4dc6-9084-0f6fa81a3837 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:50:03.081050 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-15ac4b8b-bf40-4dc6-9084-0f6fa81a3837 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] [instance: ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:50:03.088466 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-580dee82-40cf-49a6-9e72-eb5449a3f0d0 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:50:03.089230 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-580dee82-40cf-49a6-9e72-eb5449a3f0d0 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:50:03.089440 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-15ac4b8b-bf40-4dc6-9084-0f6fa81a3837 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:03.090035 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-15ac4b8b-bf40-4dc6-9084-0f6fa81a3837 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:03.090744 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-15ac4b8b-bf40-4dc6-9084-0f6fa81a3837 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:03.091154 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-15ac4b8b-bf40-4dc6-9084-0f6fa81a3837 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:03.096276 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-580dee82-40cf-49a6-9e72-eb5449a3f0d0 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:03.096276 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-580dee82-40cf-49a6-9e72-eb5449a3f0d0 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:03.096958 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-580dee82-40cf-49a6-9e72-eb5449a3f0d0 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:03.097454 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-580dee82-40cf-49a6-9e72-eb5449a3f0d0 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:03.291118 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-15ac4b8b-bf40-4dc6-9084-0f6fa81a3837 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c14e93cced14b1b95e2de8fedce31e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c0e4fa5fa246f08bb61703a42e2c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:03.298451 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-15ac4b8b-bf40-4dc6-9084-0f6fa81a3837 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] 10.222.0.64 "GET /compute/v2.1/servers/ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e" status: 200 len: 1318 microversion: 2.1 time: 0.222654 May 23 15:50:03.299217 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 431/896] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:50:03 2022] GET /compute/v2.1/servers/ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:50:03.299338 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-580dee82-40cf-49a6-9e72-eb5449a3f0d0 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:03.309320 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-580dee82-40cf-49a6-9e72-eb5449a3f0d0 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:03.310845 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-580dee82-40cf-49a6-9e72-eb5449a3f0d0 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:03.312627 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-580dee82-40cf-49a6-9e72-eb5449a3f0d0 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 200 len: 1723 microversion: 2.20 time: 0.227629 May 23 15:50:03.313230 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 466/897] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:50:03 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 1723 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:50:04.322381 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-ec003ad8-078e-4181-b546-63cb05579500 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:50:04.323699 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-ec003ad8-078e-4181-b546-63cb05579500 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] [instance: ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:50:04.334962 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-5366ccdb-f109-4d76-a1b8-35da7d5d4001 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:50:04.336256 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-5366ccdb-f109-4d76-a1b8-35da7d5d4001 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:50:04.347323 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5366ccdb-f109-4d76-a1b8-35da7d5d4001 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:04.350510 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5366ccdb-f109-4d76-a1b8-35da7d5d4001 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:04.351501 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5366ccdb-f109-4d76-a1b8-35da7d5d4001 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:04.352389 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ec003ad8-078e-4181-b546-63cb05579500 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:04.353041 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5366ccdb-f109-4d76-a1b8-35da7d5d4001 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:04.354355 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ec003ad8-078e-4181-b546-63cb05579500 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:04.357257 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ec003ad8-078e-4181-b546-63cb05579500 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:04.358023 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ec003ad8-078e-4181-b546-63cb05579500 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:05.007384 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-ec003ad8-078e-4181-b546-63cb05579500 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c14e93cced14b1b95e2de8fedce31e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c0e4fa5fa246f08bb61703a42e2c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:05.014988 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-ec003ad8-078e-4181-b546-63cb05579500 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] 10.222.0.64 "GET /compute/v2.1/servers/ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e" status: 200 len: 1318 microversion: 2.1 time: 0.702433 May 23 15:50:05.015856 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 432/898] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:50:04 2022] GET /compute/v2.1/servers/ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e => generated 1318 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:50:05.045208 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-5366ccdb-f109-4d76-a1b8-35da7d5d4001 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:05.055577 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-5366ccdb-f109-4d76-a1b8-35da7d5d4001 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:05.057233 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-5366ccdb-f109-4d76-a1b8-35da7d5d4001 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:05.058566 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-5366ccdb-f109-4d76-a1b8-35da7d5d4001 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 200 len: 1723 microversion: 2.20 time: 0.730503 May 23 15:50:05.070218 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 467/899] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:50:04 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 1723 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 15:50:05.505686 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [req-fcc5575c-10d0-41cc-87b7-4f5baa7242f3 req-ccf60124-58e1-4ece-9a24-45bdc9042c58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d9a9391-45aa-4e87-b025-839d2bf5c8a3", "name": "network-vif-deleted", "tag": "9f19c00b-8184-4f9a-bd54-44e27e1f300a"}]} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:50:05.514323 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-fcc5575c-10d0-41cc-87b7-4f5baa7242f3 req-ccf60124-58e1-4ece-9a24-45bdc9042c58 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:05.519373 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-fcc5575c-10d0-41cc-87b7-4f5baa7242f3 req-ccf60124-58e1-4ece-9a24-45bdc9042c58 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:05.527153 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.compute.server_external_events [req-fcc5575c-10d0-41cc-87b7-4f5baa7242f3 req-ccf60124-58e1-4ece-9a24-45bdc9042c58 service nova] Creating event network-vif-deleted:9f19c00b-8184-4f9a-bd54-44e27e1f300a for instance 9d9a9391-45aa-4e87-b025-839d2bf5c8a3 on hv-cinder-84067 May 23 15:50:05.532162 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [req-fcc5575c-10d0-41cc-87b7-4f5baa7242f3 req-ccf60124-58e1-4ece-9a24-45bdc9042c58 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032428 May 23 15:50:05.532742 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 433/900] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:50:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:50:06.034968 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-abeb5179-da8d-41c2-8ef6-251d10f491f9 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:50:06.038098 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-abeb5179-da8d-41c2-8ef6-251d10f491f9 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] [instance: ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:50:06.045857 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-abeb5179-da8d-41c2-8ef6-251d10f491f9 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:06.046319 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-abeb5179-da8d-41c2-8ef6-251d10f491f9 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:06.047456 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-abeb5179-da8d-41c2-8ef6-251d10f491f9 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:06.047900 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-abeb5179-da8d-41c2-8ef6-251d10f491f9 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:06.077808 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-7c2fb0f1-afa7-4fac-938a-5e5e0521b49d tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:50:06.078920 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-7c2fb0f1-afa7-4fac-938a-5e5e0521b49d tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:50:06.086379 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_cell0:SELECT=2 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:50:06.087612 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_cell0:SELECT=6 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:50:06.089540 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-7c2fb0f1-afa7-4fac-938a-5e5e0521b49d tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:06.090291 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-7c2fb0f1-afa7-4fac-938a-5e5e0521b49d tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:06.091445 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-7c2fb0f1-afa7-4fac-938a-5e5e0521b49d tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:06.092095 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-7c2fb0f1-afa7-4fac-938a-5e5e0521b49d tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:06.155895 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-7c2fb0f1-afa7-4fac-938a-5e5e0521b49d tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:06.156938 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-7c2fb0f1-afa7-4fac-938a-5e5e0521b49d tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:06.157642 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.objects.instance [None req-7c2fb0f1-afa7-4fac-938a-5e5e0521b49d tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lazy-loading 'fault' on Instance uuid 9d9a9391-45aa-4e87-b025-839d2bf5c8a3 {{(pid=124933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 15:50:06.204726 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-7c2fb0f1-afa7-4fac-938a-5e5e0521b49d tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:06.217210 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-7c2fb0f1-afa7-4fac-938a-5e5e0521b49d tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:06.217964 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-7c2fb0f1-afa7-4fac-938a-5e5e0521b49d tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:06.219211 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-7c2fb0f1-afa7-4fac-938a-5e5e0521b49d tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 200 len: 1371 microversion: 2.20 time: 0.145511 May 23 15:50:06.219779 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 434/901] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:50:06 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 1371 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 15:50:06.261400 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_cell0:SELECT=2 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:50:06.387417 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-abeb5179-da8d-41c2-8ef6-251d10f491f9 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c14e93cced14b1b95e2de8fedce31e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c0e4fa5fa246f08bb61703a42e2c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:06.395524 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-abeb5179-da8d-41c2-8ef6-251d10f491f9 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] 10.222.0.64 "GET /compute/v2.1/servers/ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e" status: 200 len: 1318 microversion: 2.1 time: 0.365739 May 23 15:50:06.396019 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 468/902] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:50:06 2022] GET /compute/v2.1/servers/ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e => generated 1318 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:50:06.683935 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [req-866f3c68-d489-44f4-9f2a-6ae800e16208 req-c9e8aed4-50c3-4e81-b3f2-6a2d6a50a1ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e", "name": "network-vif-plugged", "status": "completed", "tag": "e4eaecf3-0ea6-488b-9f92-86de045b6736"}]} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:50:06.693607 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-866f3c68-d489-44f4-9f2a-6ae800e16208 req-c9e8aed4-50c3-4e81-b3f2-6a2d6a50a1ab service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:06.694154 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-866f3c68-d489-44f4-9f2a-6ae800e16208 req-c9e8aed4-50c3-4e81-b3f2-6a2d6a50a1ab service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:06.706700 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.compute.server_external_events [req-866f3c68-d489-44f4-9f2a-6ae800e16208 req-c9e8aed4-50c3-4e81-b3f2-6a2d6a50a1ab service nova] Creating event network-vif-plugged:e4eaecf3-0ea6-488b-9f92-86de045b6736 for instance ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e on hv-cinder-84067 May 23 15:50:06.714212 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [req-866f3c68-d489-44f4-9f2a-6ae800e16208 req-c9e8aed4-50c3-4e81-b3f2-6a2d6a50a1ab service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034058 May 23 15:50:06.715307 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 435/903] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:50:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:50:07.239193 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-9afbc376-14f6-4d71-a998-23ed6573fcca tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:50:07.239803 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-9afbc376-14f6-4d71-a998-23ed6573fcca tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:50:07.246288 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-9afbc376-14f6-4d71-a998-23ed6573fcca tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:07.246738 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-9afbc376-14f6-4d71-a998-23ed6573fcca tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:07.247507 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-9afbc376-14f6-4d71-a998-23ed6573fcca tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:07.247985 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-9afbc376-14f6-4d71-a998-23ed6573fcca tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:07.262798 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.wsgi [None req-9afbc376-14f6-4d71-a998-23ed6573fcca tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] HTTP exception thrown: Instance 9d9a9391-45aa-4e87-b025-839d2bf5c8a3 could not be found. May 23 15:50:07.264467 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-9afbc376-14f6-4d71-a998-23ed6573fcca tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Request method failure captured: May 23 15:50:07.264467 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: request: GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 HTTP/1.1 May 23 15:50:07.264467 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Accept: application/json May 23 15:50:07.264467 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Accept-Encoding: identity May 23 15:50:07.264467 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Connection: close May 23 15:50:07.264467 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Content-Length: 0 May 23 15:50:07.264467 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Content-Type: application/json May 23 15:50:07.264467 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Host: 10.222.0.64 May 23 15:50:07.264467 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Openstack-System-Scope: None May 23 15:50:07.264467 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: User-Agent: python-urllib3/1.26.9 May 23 15:50:07.264467 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Auth-Token: gAAAAABii6yD677URC8Wr3a-Me9HgLrk9MN-kVk73UomYhEw3NQaqrmysijC6sCthK-zBBWIX5OOisctblImVKmhiCFxEy-UN7m1EPD2NDi9T6xal8nU9psILVaIeCep9NXPy7v95R6W-3Oju79domZJ9BQ2ZunRFBQnQM3WqUPbcfYJUOb6j3A May 23 15:50:07.264467 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Domain-Id: None May 23 15:50:07.264467 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Domain-Name: None May 23 15:50:07.264467 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Identity-Status: Confirmed May 23 15:50:07.264467 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Is-Admin-Project: True May 23 15:50:07.264467 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Openstack-Nova-Api-Version: 2.20 May 23 15:50:07.264467 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Domain-Id: default May 23 15:50:07.264467 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Domain-Name: Default May 23 15:50:07.264467 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Id: 749e4849b23b4e42be64ef0ab0330a0b May 23 15:50:07.264467 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-963625688 May 23 15:50:07.264467 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Role: reader,member May 23 15:50:07.264467 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Roles: reader,member May 23 15:50:07.266286 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/749e4849b23b4e42be64ef0ab0330a0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/749e4849b23b4e42be64ef0ab0330a0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/749e4849b23b4e42be64ef0ab0330a0b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_749e4849b23b4e42be64ef0ab0330a0b", "adminURL": "http://10.222.0.64:8080"}]}] May 23 15:50:07.266286 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant: tempest-AttachVolumeShelveTestJSON-963625688 May 23 15:50:07.266286 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant-Id: 749e4849b23b4e42be64ef0ab0330a0b May 23 15:50:07.266286 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-963625688 May 23 15:50:07.266286 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User: tempest-AttachVolumeShelveTestJSON-963625688-project May 23 15:50:07.266286 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Domain-Id: default May 23 15:50:07.266286 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Domain-Name: Default May 23 15:50:07.266286 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Id: 7a5fc191f3464ffe83d5fde2419cb8b4 May 23 15:50:07.266286 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Name: tempest-AttachVolumeShelveTestJSON-963625688-project May 23 15:50:07.266286 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: method: > May 23 15:50:07.266286 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: exception: Instance 9d9a9391-45aa-4e87-b025-839d2bf5c8a3 could not be found. May 23 15:50:07.266286 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: action_args: {'id': '9d9a9391-45aa-4e87-b025-839d2bf5c8a3'} May 23 15:50:07.267267 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:50:07.267267 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:50:07.267267 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:50:07.267267 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:50:07.267267 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:50:07.267267 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:50:07.267267 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:50:07.267267 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:50:07.267267 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:50:07.267267 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:50:07.267267 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d9a9391-45aa-4e87-b025-839d2bf5c8a3 could not be found. May 23 15:50:07.267267 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:50:07.267267 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:50:07.267267 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:50:07.267267 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:50:07.267267 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:50:07.267267 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:50:07.267267 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:50:07.267267 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:50:07.267267 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:50:07.269053 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:50:07.269053 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 15:50:07.269053 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 15:50:07.269053 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:50:07.269053 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:50:07.269053 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:50:07.269053 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:50:07.269053 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d9a9391-45aa-4e87-b025-839d2bf5c8a3 could not be found. May 23 15:50:07.269053 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:50:07.269053 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:50:07.269053 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:50:07.269053 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:50:07.269053 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:50:07.269053 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:50:07.269053 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:50:07.269053 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:50:07.269053 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d9a9391-45aa-4e87-b025-839d2bf5c8a3 could not be found. May 23 15:50:07.269053 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:50:07.270424 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-9afbc376-14f6-4d71-a998-23ed6573fcca tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Returning 404 to user: Instance 9d9a9391-45aa-4e87-b025-839d2bf5c8a3 could not be found. {{(pid=124934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:50:07.270424 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-9afbc376-14f6-4d71-a998-23ed6573fcca tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 404 len: 111 microversion: 2.20 time: 0.032182 May 23 15:50:07.270424 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 469/904] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:50:07 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 23 15:50:07.276657 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-9d3d18c0-e368-4385-b288-0ef14cb3ba95 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '.version_select at 0x7fab51d67d30>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:50:07.337006 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-9d3d18c0-e368-4385-b288-0ef14cb3ba95 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1875959502" status: 204 len: 0 microversion: 2.20 time: 0.064473 May 23 15:50:07.337622 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 436/905] 10.222.0.64 () {60 vars in 1261 bytes} [Mon May 23 15:50:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1875959502 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 23 15:50:07.412962 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-377e8d84-9480-4d03-a65f-a0da3b5548d2 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:50:07.413706 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-377e8d84-9480-4d03-a65f-a0da3b5548d2 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] [instance: ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:50:07.419770 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-377e8d84-9480-4d03-a65f-a0da3b5548d2 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:07.420216 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-377e8d84-9480-4d03-a65f-a0da3b5548d2 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:07.420986 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-377e8d84-9480-4d03-a65f-a0da3b5548d2 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:07.421443 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-377e8d84-9480-4d03-a65f-a0da3b5548d2 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:07.557345 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-377e8d84-9480-4d03-a65f-a0da3b5548d2 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c14e93cced14b1b95e2de8fedce31e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c0e4fa5fa246f08bb61703a42e2c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:07.565242 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-377e8d84-9480-4d03-a65f-a0da3b5548d2 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] 10.222.0.64 "GET /compute/v2.1/servers/ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e" status: 200 len: 1318 microversion: 2.1 time: 0.156813 May 23 15:50:07.565834 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 470/906] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:50:07 2022] GET /compute/v2.1/servers/ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:50:08.181374 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-7a3bc156-3fe1-48e2-89df-b42a2be2e650 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Action: 'create', calling method: .version_select at 0x7fab51dd9ca0>, body: {"keypair": {"name": "tempest-keypair-76584187", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLi0dIEF5WpYfSGCojHnZF9IVZmJ04thTUwJKsgc+yOF4skd4qSLWpvYGzZPER3pU6UZA8LpbS06hHQ+otSbUJ6pgw7uUeT6kVkoRzL5QiO6bH+iZPo1m9J/dDKxLbmh/A=="}} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:50:08.195613 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.quota [None req-7a3bc156-3fe1-48e2-89df-b42a2be2e650 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Getting quotas for project 749e4849b23b4e42be64ef0ab0330a0b. Resources: {'key_pairs'} {{(pid=124933) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 15:50:08.199454 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.quota [None req-7a3bc156-3fe1-48e2-89df-b42a2be2e650 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Getting quotas for user 7a5fc191f3464ffe83d5fde2419cb8b4 and project 749e4849b23b4e42be64ef0ab0330a0b. Resources: {'key_pairs'} {{(pid=124933) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 15:50:08.303244 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-7a3bc156-3fe1-48e2-89df-b42a2be2e650 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.126230 May 23 15:50:08.303840 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 437/907] 10.222.0.64 () {62 vars in 1199 bytes} [Mon May 23 15:50:08 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 128 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 23 15:50:08.584767 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-1232d9d2-c902-4c9b-8d4c-336a802e8842 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:50:08.586043 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-1232d9d2-c902-4c9b-8d4c-336a802e8842 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] [instance: ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:50:08.592835 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-1232d9d2-c902-4c9b-8d4c-336a802e8842 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:08.593348 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-1232d9d2-c902-4c9b-8d4c-336a802e8842 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:08.594154 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-1232d9d2-c902-4c9b-8d4c-336a802e8842 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:08.594625 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-1232d9d2-c902-4c9b-8d4c-336a802e8842 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:08.776286 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-1232d9d2-c902-4c9b-8d4c-336a802e8842 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c14e93cced14b1b95e2de8fedce31e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c0e4fa5fa246f08bb61703a42e2c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:08.783650 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-1232d9d2-c902-4c9b-8d4c-336a802e8842 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] 10.222.0.64 "GET /compute/v2.1/servers/ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e" status: 200 len: 1506 microversion: 2.1 time: 0.204107 May 23 15:50:08.784198 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 471/908] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:50:08 2022] GET /compute/v2.1/servers/ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e => generated 1506 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:50:10.851382 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-c28f94e2-183a-49e7-b84f-ed8d470c9c45 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1555675971", "imageRef": "a5c8503f-3733-426f-8a5b-c7c9358e4a45", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8fb40c4e-9164-4617-9793-abd2286f1896"}], "security_groups": [{"name": "tempest-securitygroup--246053123"}], "key_name": "tempest-keypair-76584187", "user_data": "}} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:50:10.951439 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.network.neutron [None req-c28f94e2-183a-49e7-b84f-ed8d470c9c45 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] validate_networks() for [('8fb40c4e-9164-4617-9793-abd2286f1896', None, None, None, None, None)] {{(pid=124933) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 15:50:11.311689 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.virt.hardware [None req-c28f94e2-183a-49e7-b84f-ed8d470c9c45 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Flavor limits 0:0:0 {{(pid=124933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 15:50:11.312112 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.virt.hardware [None req-c28f94e2-183a-49e7-b84f-ed8d470c9c45 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Image limits 0:0:0 {{(pid=124933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 15:50:11.312585 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.virt.hardware [None req-c28f94e2-183a-49e7-b84f-ed8d470c9c45 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Flavor pref 0:0:0 {{(pid=124933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 15:50:11.313019 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.virt.hardware [None req-c28f94e2-183a-49e7-b84f-ed8d470c9c45 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Image pref 0:0:0 {{(pid=124933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 15:50:11.313456 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.virt.hardware [None req-c28f94e2-183a-49e7-b84f-ed8d470c9c45 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 15:50:11.322514 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c28f94e2-183a-49e7-b84f-ed8d470c9c45 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:11.322959 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c28f94e2-183a-49e7-b84f-ed8d470c9c45 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:11.323748 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c28f94e2-183a-49e7-b84f-ed8d470c9c45 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:11.324180 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c28f94e2-183a-49e7-b84f-ed8d470c9c45 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:11.341038 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.quota [None req-c28f94e2-183a-49e7-b84f-ed8d470c9c45 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Getting quotas for project 749e4849b23b4e42be64ef0ab0330a0b. Resources: {'ram', 'instances', 'cores'} {{(pid=124933) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 15:50:11.344890 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.quota [None req-c28f94e2-183a-49e7-b84f-ed8d470c9c45 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Getting quotas for user 7a5fc191f3464ffe83d5fde2419cb8b4 and project 749e4849b23b4e42be64ef0ab0330a0b. Resources: {'ram', 'instances', 'cores'} {{(pid=124933) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 15:50:11.356543 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-c28f94e2-183a-49e7-b84f-ed8d470c9c45 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Going to run 1 instances... {{(pid=124933) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 15:50:11.358965 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-c28f94e2-183a-49e7-b84f-ed8d470c9c45 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5c8503f-3733-426f-8a5b-c7c9358e4a45',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124933) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 15:50:11.503473 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-c28f94e2-183a-49e7-b84f-ed8d470c9c45 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.656987 May 23 15:50:11.504114 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 438/909] 10.222.0.64 () {62 vars in 1187 bytes} [Mon May 23 15:50:10 2022] POST /compute/v2.1/servers => generated 401 bytes in 658 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) May 23 15:50:11.514692 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-e3abdf1a-3238-45b9-881f-ff0cf7ff3e29 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:50:11.515304 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-e3abdf1a-3238-45b9-881f-ff0cf7ff3e29 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:50:11.570014 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-e3abdf1a-3238-45b9-881f-ff0cf7ff3e29 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:11.577191 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-e3abdf1a-3238-45b9-881f-ff0cf7ff3e29 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:11.578692 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-e3abdf1a-3238-45b9-881f-ff0cf7ff3e29 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:11.579789 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-e3abdf1a-3238-45b9-881f-ff0cf7ff3e29 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305" status: 200 len: 1280 microversion: 2.20 time: 0.069065 May 23 15:50:11.580331 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 472/910] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:50:11 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 => generated 1280 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:50:12.599919 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-c26a1f8d-457b-4930-8f7c-0eb9b13a7001 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:50:12.600893 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-c26a1f8d-457b-4930-8f7c-0eb9b13a7001 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:50:12.608313 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c26a1f8d-457b-4930-8f7c-0eb9b13a7001 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:12.608813 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c26a1f8d-457b-4930-8f7c-0eb9b13a7001 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:12.609585 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c26a1f8d-457b-4930-8f7c-0eb9b13a7001 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:12.610028 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c26a1f8d-457b-4930-8f7c-0eb9b13a7001 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:12.677701 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-c26a1f8d-457b-4930-8f7c-0eb9b13a7001 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:12.689978 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-c26a1f8d-457b-4930-8f7c-0eb9b13a7001 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:12.689978 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-c26a1f8d-457b-4930-8f7c-0eb9b13a7001 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:12.690590 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-c26a1f8d-457b-4930-8f7c-0eb9b13a7001 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305" status: 200 len: 1284 microversion: 2.20 time: 0.096426 May 23 15:50:12.691149 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 439/911] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:50:12 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 => generated 1284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:50:13.710553 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-ad114394-8194-4205-979c-0c027b23f502 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:50:13.711809 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-ad114394-8194-4205-979c-0c027b23f502 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:50:13.719179 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ad114394-8194-4205-979c-0c027b23f502 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:13.724620 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ad114394-8194-4205-979c-0c027b23f502 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:13.724620 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ad114394-8194-4205-979c-0c027b23f502 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:13.724620 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ad114394-8194-4205-979c-0c027b23f502 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:13.820491 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-ad114394-8194-4205-979c-0c027b23f502 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:13.830464 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-ad114394-8194-4205-979c-0c027b23f502 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:13.831973 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-ad114394-8194-4205-979c-0c027b23f502 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:13.833106 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-ad114394-8194-4205-979c-0c027b23f502 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305" status: 200 len: 1340 microversion: 2.20 time: 0.126911 May 23 15:50:13.833651 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 473/912] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:50:13 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 => generated 1340 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:50:14.852737 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-11f70a67-bd93-40d6-84e3-7e6b603686dc tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:50:14.854417 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-11f70a67-bd93-40d6-84e3-7e6b603686dc tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:50:14.861841 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-11f70a67-bd93-40d6-84e3-7e6b603686dc tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:14.862294 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-11f70a67-bd93-40d6-84e3-7e6b603686dc tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:14.863114 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-11f70a67-bd93-40d6-84e3-7e6b603686dc tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:14.864060 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-11f70a67-bd93-40d6-84e3-7e6b603686dc tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:15.038671 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-11f70a67-bd93-40d6-84e3-7e6b603686dc tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:15.048052 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-11f70a67-bd93-40d6-84e3-7e6b603686dc tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:15.049576 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-11f70a67-bd93-40d6-84e3-7e6b603686dc tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:15.050931 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-11f70a67-bd93-40d6-84e3-7e6b603686dc tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305" status: 200 len: 1405 microversion: 2.20 time: 0.203310 May 23 15:50:15.051482 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 440/913] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:50:14 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 => generated 1405 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:50:15.410775 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [req-ae8a482c-dc6b-412f-9fbd-140ab2236af1 req-61cf7af8-8b67-454c-882b-8acd1d84a267 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e0a2baa-19d3-46f7-8585-c5272f971305", "tag": "afbaeb47-bccc-4c5c-8309-2469ca000cc2"}]} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:50:15.424139 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-ae8a482c-dc6b-412f-9fbd-140ab2236af1 req-61cf7af8-8b67-454c-882b-8acd1d84a267 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:15.432571 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-ae8a482c-dc6b-412f-9fbd-140ab2236af1 req-61cf7af8-8b67-454c-882b-8acd1d84a267 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:15.444546 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.compute.server_external_events [req-ae8a482c-dc6b-412f-9fbd-140ab2236af1 req-61cf7af8-8b67-454c-882b-8acd1d84a267 service nova] Creating event network-changed:afbaeb47-bccc-4c5c-8309-2469ca000cc2 for instance 6e0a2baa-19d3-46f7-8585-c5272f971305 on hv-cinder-84067 May 23 15:50:15.450336 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [req-ae8a482c-dc6b-412f-9fbd-140ab2236af1 req-61cf7af8-8b67-454c-882b-8acd1d84a267 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051164 May 23 15:50:15.455476 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 474/914] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:50:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:50:16.081777 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-2fdf1578-e51a-4891-b359-b223bd6abe8d tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:50:16.082404 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-2fdf1578-e51a-4891-b359-b223bd6abe8d tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:50:16.089465 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-2fdf1578-e51a-4891-b359-b223bd6abe8d tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:16.089915 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-2fdf1578-e51a-4891-b359-b223bd6abe8d tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:16.090807 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-2fdf1578-e51a-4891-b359-b223bd6abe8d tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:16.091298 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-2fdf1578-e51a-4891-b359-b223bd6abe8d tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:16.303964 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-2fdf1578-e51a-4891-b359-b223bd6abe8d tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:16.306783 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-2fdf1578-e51a-4891-b359-b223bd6abe8d tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:16.308307 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-2fdf1578-e51a-4891-b359-b223bd6abe8d tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:16.309447 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-2fdf1578-e51a-4891-b359-b223bd6abe8d tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305" status: 200 len: 1405 microversion: 2.20 time: 0.233116 May 23 15:50:16.309987 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 441/915] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:50:16 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 => generated 1405 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:50:17.328029 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-0044bc04-0b86-41c8-ba15-b4bc46ca591f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:50:17.328731 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-0044bc04-0b86-41c8-ba15-b4bc46ca591f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:50:17.335445 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0044bc04-0b86-41c8-ba15-b4bc46ca591f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:17.335910 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0044bc04-0b86-41c8-ba15-b4bc46ca591f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:17.336900 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0044bc04-0b86-41c8-ba15-b4bc46ca591f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:17.337132 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0044bc04-0b86-41c8-ba15-b4bc46ca591f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:17.476324 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-0044bc04-0b86-41c8-ba15-b4bc46ca591f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:17.484850 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-0044bc04-0b86-41c8-ba15-b4bc46ca591f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:17.486430 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-0044bc04-0b86-41c8-ba15-b4bc46ca591f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:17.487721 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-0044bc04-0b86-41c8-ba15-b4bc46ca591f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305" status: 200 len: 1405 microversion: 2.20 time: 0.163803 May 23 15:50:17.488261 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 475/916] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:50:17 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 => generated 1405 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:50:18.506721 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-cc8293df-99b9-44f1-95bb-98283b4f6367 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:50:18.514615 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-cc8293df-99b9-44f1-95bb-98283b4f6367 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:50:18.525423 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-cc8293df-99b9-44f1-95bb-98283b4f6367 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:18.525882 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-cc8293df-99b9-44f1-95bb-98283b4f6367 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:18.526666 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-cc8293df-99b9-44f1-95bb-98283b4f6367 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:18.527126 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-cc8293df-99b9-44f1-95bb-98283b4f6367 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:18.677782 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-cc8293df-99b9-44f1-95bb-98283b4f6367 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:18.695139 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-cc8293df-99b9-44f1-95bb-98283b4f6367 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:18.695139 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-cc8293df-99b9-44f1-95bb-98283b4f6367 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:18.695139 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-cc8293df-99b9-44f1-95bb-98283b4f6367 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305" status: 200 len: 1405 microversion: 2.20 time: 0.191313 May 23 15:50:18.695560 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 442/917] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:50:18 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 => generated 1405 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:50:19.714077 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-11c956d6-7351-4ede-9155-7332270527c1 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:50:19.714726 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-11c956d6-7351-4ede-9155-7332270527c1 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:50:19.722897 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-11c956d6-7351-4ede-9155-7332270527c1 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:19.723670 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-11c956d6-7351-4ede-9155-7332270527c1 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:19.724845 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-11c956d6-7351-4ede-9155-7332270527c1 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:19.725490 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-11c956d6-7351-4ede-9155-7332270527c1 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:19.745285 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:50:19.894808 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-11c956d6-7351-4ede-9155-7332270527c1 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:19.904162 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-11c956d6-7351-4ede-9155-7332270527c1 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:19.905817 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-11c956d6-7351-4ede-9155-7332270527c1 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:19.907017 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-11c956d6-7351-4ede-9155-7332270527c1 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305" status: 200 len: 1405 microversion: 2.20 time: 0.198688 May 23 15:50:19.907764 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 476/918] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:50:19 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 => generated 1405 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:50:20.927228 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-44bd1bca-d5c6-47b7-96d9-81ccf30f7f92 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:50:20.927843 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-44bd1bca-d5c6-47b7-96d9-81ccf30f7f92 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:50:20.930287 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:50:20.935538 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-44bd1bca-d5c6-47b7-96d9-81ccf30f7f92 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:20.936028 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-44bd1bca-d5c6-47b7-96d9-81ccf30f7f92 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:20.936808 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-44bd1bca-d5c6-47b7-96d9-81ccf30f7f92 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:20.937291 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-44bd1bca-d5c6-47b7-96d9-81ccf30f7f92 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:20.941277 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_cell1:SELECT=91 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:50:21.076972 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-44bd1bca-d5c6-47b7-96d9-81ccf30f7f92 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:21.085452 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-44bd1bca-d5c6-47b7-96d9-81ccf30f7f92 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:21.087660 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-44bd1bca-d5c6-47b7-96d9-81ccf30f7f92 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:21.089219 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-44bd1bca-d5c6-47b7-96d9-81ccf30f7f92 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305" status: 200 len: 1405 microversion: 2.20 time: 0.166050 May 23 15:50:21.090013 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 443/919] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:50:20 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 => generated 1405 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:50:22.108185 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-1fade3b1-2d15-44b3-bd0b-8d16d3fb3f9b tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:50:22.108889 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-1fade3b1-2d15-44b3-bd0b-8d16d3fb3f9b tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:50:22.112284 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_cell0:SELECT=2 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:50:22.112935 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:50:22.116410 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-1fade3b1-2d15-44b3-bd0b-8d16d3fb3f9b tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:22.116874 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-1fade3b1-2d15-44b3-bd0b-8d16d3fb3f9b tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:22.119094 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-1fade3b1-2d15-44b3-bd0b-8d16d3fb3f9b tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:22.119544 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-1fade3b1-2d15-44b3-bd0b-8d16d3fb3f9b tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:22.252890 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-1fade3b1-2d15-44b3-bd0b-8d16d3fb3f9b tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:22.263771 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-1fade3b1-2d15-44b3-bd0b-8d16d3fb3f9b tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:22.265630 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-1fade3b1-2d15-44b3-bd0b-8d16d3fb3f9b tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:22.266747 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-1fade3b1-2d15-44b3-bd0b-8d16d3fb3f9b tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305" status: 200 len: 1405 microversion: 2.20 time: 0.162688 May 23 15:50:22.267287 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 477/920] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:50:22 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 => generated 1405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:50:23.285317 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-41f8bd53-d400-4f02-a1ac-6b6216c2e5d0 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:50:23.286030 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-41f8bd53-d400-4f02-a1ac-6b6216c2e5d0 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:50:23.288422 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_cell0:SELECT=2 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:50:23.289169 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_cell0:SELECT=10 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:50:23.297393 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-41f8bd53-d400-4f02-a1ac-6b6216c2e5d0 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:23.297865 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-41f8bd53-d400-4f02-a1ac-6b6216c2e5d0 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:23.298689 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-41f8bd53-d400-4f02-a1ac-6b6216c2e5d0 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:23.299134 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-41f8bd53-d400-4f02-a1ac-6b6216c2e5d0 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:23.437710 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-41f8bd53-d400-4f02-a1ac-6b6216c2e5d0 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:23.446096 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-41f8bd53-d400-4f02-a1ac-6b6216c2e5d0 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:23.447609 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-41f8bd53-d400-4f02-a1ac-6b6216c2e5d0 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:23.448798 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-41f8bd53-d400-4f02-a1ac-6b6216c2e5d0 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305" status: 200 len: 1405 microversion: 2.20 time: 0.167815 May 23 15:50:23.449389 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 444/921] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:50:23 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 => generated 1405 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:50:23.749726 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [req-944b2574-c4c1-470d-a7be-9f034fb3e978 req-0d2c7dbb-ccdf-4379-bd22-984b499bd79d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e0a2baa-19d3-46f7-8585-c5272f971305", "name": "network-vif-plugged", "status": "completed", "tag": "afbaeb47-bccc-4c5c-8309-2469ca000cc2"}]} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:50:23.758784 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-944b2574-c4c1-470d-a7be-9f034fb3e978 req-0d2c7dbb-ccdf-4379-bd22-984b499bd79d service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:23.759273 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-944b2574-c4c1-470d-a7be-9f034fb3e978 req-0d2c7dbb-ccdf-4379-bd22-984b499bd79d service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:23.770590 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.compute.server_external_events [req-944b2574-c4c1-470d-a7be-9f034fb3e978 req-0d2c7dbb-ccdf-4379-bd22-984b499bd79d service nova] Creating event network-vif-plugged:afbaeb47-bccc-4c5c-8309-2469ca000cc2 for instance 6e0a2baa-19d3-46f7-8585-c5272f971305 on hv-cinder-84067 May 23 15:50:23.776007 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [req-944b2574-c4c1-470d-a7be-9f034fb3e978 req-0d2c7dbb-ccdf-4379-bd22-984b499bd79d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031063 May 23 15:50:23.776568 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 478/922] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:50:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:50:24.467733 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-305ebd6a-818c-4d60-8980-177a5bc5d44b tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:50:24.468343 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-305ebd6a-818c-4d60-8980-177a5bc5d44b tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:50:24.474857 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-305ebd6a-818c-4d60-8980-177a5bc5d44b tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:24.475309 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-305ebd6a-818c-4d60-8980-177a5bc5d44b tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:24.476208 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-305ebd6a-818c-4d60-8980-177a5bc5d44b tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:24.476650 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-305ebd6a-818c-4d60-8980-177a5bc5d44b tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:24.613026 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-305ebd6a-818c-4d60-8980-177a5bc5d44b tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:24.621908 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-305ebd6a-818c-4d60-8980-177a5bc5d44b tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:24.623580 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-305ebd6a-818c-4d60-8980-177a5bc5d44b tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:24.624676 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-305ebd6a-818c-4d60-8980-177a5bc5d44b tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305" status: 200 len: 1405 microversion: 2.20 time: 0.161021 May 23 15:50:24.625268 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 445/923] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:50:24 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 => generated 1405 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:50:25.644021 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-60222ddf-9e29-416b-a822-6d46bc96520d tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:50:25.644722 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-60222ddf-9e29-416b-a822-6d46bc96520d tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:50:25.651641 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-60222ddf-9e29-416b-a822-6d46bc96520d tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:25.652097 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-60222ddf-9e29-416b-a822-6d46bc96520d tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:25.652879 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-60222ddf-9e29-416b-a822-6d46bc96520d tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:25.653354 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-60222ddf-9e29-416b-a822-6d46bc96520d tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:25.790836 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-60222ddf-9e29-416b-a822-6d46bc96520d tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:25.798884 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-60222ddf-9e29-416b-a822-6d46bc96520d tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:25.800621 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-60222ddf-9e29-416b-a822-6d46bc96520d tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:25.801782 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-60222ddf-9e29-416b-a822-6d46bc96520d tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305" status: 200 len: 1405 microversion: 2.20 time: 0.162865 May 23 15:50:25.802536 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 479/924] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:50:25 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 => generated 1405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:50:26.456579 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-d4de71ed-995f-495e-be58-4ed94824743f tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2105000587", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1689259836", "security_groups": [{"name": "tempest-secgroup-smoke-2071772138"}], "block_device_mapping_v2": [{"uuid": "f17a9c22-d777-4ee0-ac64-eaf216349be9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "719fa7d2-b22e-4ff9-afc9-c7cbf4d644a6"}]}} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:50:26.570056 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.network.neutron [None req-d4de71ed-995f-495e-be58-4ed94824743f tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] validate_networks() for [('719fa7d2-b22e-4ff9-afc9-c7cbf4d644a6', None, None, None, None, None)] {{(pid=124933) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 15:50:26.819738 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-65eb5b80-abd2-4e25-bbf9-acdf59522de6 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:50:26.821844 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-65eb5b80-abd2-4e25-bbf9-acdf59522de6 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:50:26.828742 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-65eb5b80-abd2-4e25-bbf9-acdf59522de6 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:26.829332 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-65eb5b80-abd2-4e25-bbf9-acdf59522de6 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:26.830123 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-65eb5b80-abd2-4e25-bbf9-acdf59522de6 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:26.830561 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-65eb5b80-abd2-4e25-bbf9-acdf59522de6 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:27.006911 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.virt.hardware [None req-d4de71ed-995f-495e-be58-4ed94824743f tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Flavor limits 0:0:0 {{(pid=124933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 15:50:27.007562 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.virt.hardware [None req-d4de71ed-995f-495e-be58-4ed94824743f tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Image limits 0:0:0 {{(pid=124933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 15:50:27.008767 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.virt.hardware [None req-d4de71ed-995f-495e-be58-4ed94824743f tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Flavor pref 0:0:0 {{(pid=124933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 15:50:27.009210 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.virt.hardware [None req-d4de71ed-995f-495e-be58-4ed94824743f tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Image pref 0:0:0 {{(pid=124933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 15:50:27.009635 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.virt.hardware [None req-d4de71ed-995f-495e-be58-4ed94824743f tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 15:50:27.019491 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-d4de71ed-995f-495e-be58-4ed94824743f tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:27.019956 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-d4de71ed-995f-495e-be58-4ed94824743f tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:27.020789 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-d4de71ed-995f-495e-be58-4ed94824743f tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:27.021268 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-d4de71ed-995f-495e-be58-4ed94824743f tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:27.038463 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.quota [None req-d4de71ed-995f-495e-be58-4ed94824743f tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Getting quotas for project 6263581d20ea47bcae22d736f7934e05. Resources: {'ram', 'instances', 'cores'} {{(pid=124933) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 15:50:27.038604 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-65eb5b80-abd2-4e25-bbf9-acdf59522de6 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:27.042570 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.quota [None req-d4de71ed-995f-495e-be58-4ed94824743f tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Getting quotas for user ba0229c6732541b4a6dda9040c038686 and project 6263581d20ea47bcae22d736f7934e05. Resources: {'ram', 'instances', 'cores'} {{(pid=124933) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 15:50:27.046859 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-65eb5b80-abd2-4e25-bbf9-acdf59522de6 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:27.048382 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-65eb5b80-abd2-4e25-bbf9-acdf59522de6 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:27.049574 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-65eb5b80-abd2-4e25-bbf9-acdf59522de6 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305" status: 200 len: 1596 microversion: 2.20 time: 0.233797 May 23 15:50:27.050385 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 480/925] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:50:26 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 => generated 1596 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 15:50:27.067801 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-a63bc463-3c54-4e75-8f57-97b739f5644d tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:50:27.068292 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-a63bc463-3c54-4e75-8f57-97b739f5644d tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:50:27.075184 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-a63bc463-3c54-4e75-8f57-97b739f5644d tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:27.075646 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-a63bc463-3c54-4e75-8f57-97b739f5644d tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:27.076446 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-a63bc463-3c54-4e75-8f57-97b739f5644d tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:27.076922 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-a63bc463-3c54-4e75-8f57-97b739f5644d tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:27.102112 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-d4de71ed-995f-495e-be58-4ed94824743f tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Going to run 1 instances... {{(pid=124933) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 15:50:27.104184 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-d4de71ed-995f-495e-be58-4ed94824743f tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: 99616012-21ed-48f0-a80e-e08de807a0f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f17a9c22-d777-4ee0-ac64-eaf216349be9',volume_size=None,volume_type=None)] {{(pid=124933) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 15:50:27.154756 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-a63bc463-3c54-4e75-8f57-97b739f5644d tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.090587 May 23 15:50:27.155358 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 481/926] 10.222.0.64 () {60 vars in 1315 bytes} [Mon May 23 15:50:27 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 15:50:27.701764 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-d4de71ed-995f-495e-be58-4ed94824743f tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.248681 May 23 15:50:27.702449 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 446/927] 10.222.0.64 () {60 vars in 1146 bytes} [Mon May 23 15:50:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 1250 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 23 15:50:27.713973 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-74857080-189e-445d-9bc8-e9a164a27499 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:50:27.714620 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-74857080-189e-445d-9bc8-e9a164a27499 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: 99616012-21ed-48f0-a80e-e08de807a0f7] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:50:27.784423 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-74857080-189e-445d-9bc8-e9a164a27499 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:27.794249 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-74857080-189e-445d-9bc8-e9a164a27499 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/99616012-21ed-48f0-a80e-e08de807a0f7" status: 200 len: 1095 microversion: 2.1 time: 0.085116 May 23 15:50:27.794810 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 482/928] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:50:27 2022] GET /compute/v2.1/servers/99616012-21ed-48f0-a80e-e08de807a0f7 => generated 1095 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:50:28.514377 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [req-6584c748-e555-4b3e-baa4-47cfe068ba07 req-a38f4e04-dab3-4ff5-bfdf-24693f39419a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e0a2baa-19d3-46f7-8585-c5272f971305", "tag": "afbaeb47-bccc-4c5c-8309-2469ca000cc2"}]} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:50:28.524058 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-6584c748-e555-4b3e-baa4-47cfe068ba07 req-a38f4e04-dab3-4ff5-bfdf-24693f39419a service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:28.524697 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-6584c748-e555-4b3e-baa4-47cfe068ba07 req-a38f4e04-dab3-4ff5-bfdf-24693f39419a service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:28.537343 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.compute.server_external_events [req-6584c748-e555-4b3e-baa4-47cfe068ba07 req-a38f4e04-dab3-4ff5-bfdf-24693f39419a service nova] Creating event network-changed:afbaeb47-bccc-4c5c-8309-2469ca000cc2 for instance 6e0a2baa-19d3-46f7-8585-c5272f971305 on hv-cinder-84067 May 23 15:50:28.543004 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [req-6584c748-e555-4b3e-baa4-47cfe068ba07 req-a38f4e04-dab3-4ff5-bfdf-24693f39419a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032789 May 23 15:50:28.544192 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 447/929] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:50:28.812783 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-b5dd4eb5-0105-4dbc-ba70-56fb5ffd8bf6 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:50:28.813625 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-b5dd4eb5-0105-4dbc-ba70-56fb5ffd8bf6 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: 99616012-21ed-48f0-a80e-e08de807a0f7] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:50:28.821206 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-b5dd4eb5-0105-4dbc-ba70-56fb5ffd8bf6 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:28.821985 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-b5dd4eb5-0105-4dbc-ba70-56fb5ffd8bf6 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:28.823377 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-b5dd4eb5-0105-4dbc-ba70-56fb5ffd8bf6 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:28.824100 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-b5dd4eb5-0105-4dbc-ba70-56fb5ffd8bf6 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:28.920215 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-b5dd4eb5-0105-4dbc-ba70-56fb5ffd8bf6 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:28.939553 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-b5dd4eb5-0105-4dbc-ba70-56fb5ffd8bf6 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/99616012-21ed-48f0-a80e-e08de807a0f7" status: 200 len: 1145 microversion: 2.1 time: 0.126778 May 23 15:50:28.939553 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 483/930] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:50:28 2022] GET /compute/v2.1/servers/99616012-21ed-48f0-a80e-e08de807a0f7 => generated 1145 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:50:29.953697 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-efc552c2-c012-4308-b0dd-e586f93eb3bb tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:50:29.954556 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-efc552c2-c012-4308-b0dd-e586f93eb3bb tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: 99616012-21ed-48f0-a80e-e08de807a0f7] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:50:29.961786 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-efc552c2-c012-4308-b0dd-e586f93eb3bb tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:29.962565 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-efc552c2-c012-4308-b0dd-e586f93eb3bb tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:29.963784 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-efc552c2-c012-4308-b0dd-e586f93eb3bb tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:29.964307 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-efc552c2-c012-4308-b0dd-e586f93eb3bb tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:30.037492 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-efc552c2-c012-4308-b0dd-e586f93eb3bb tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:30.046076 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-efc552c2-c012-4308-b0dd-e586f93eb3bb tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/99616012-21ed-48f0-a80e-e08de807a0f7" status: 200 len: 1201 microversion: 2.1 time: 0.097266 May 23 15:50:30.047356 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 448/931] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:50:29 2022] GET /compute/v2.1/servers/99616012-21ed-48f0-a80e-e08de807a0f7 => generated 1201 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:50:31.065627 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-57de95e4-1272-4a1f-ba7e-b7ec7b341769 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:50:31.066243 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-57de95e4-1272-4a1f-ba7e-b7ec7b341769 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: 99616012-21ed-48f0-a80e-e08de807a0f7] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:50:31.073441 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-57de95e4-1272-4a1f-ba7e-b7ec7b341769 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:31.073904 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-57de95e4-1272-4a1f-ba7e-b7ec7b341769 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:31.074693 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-57de95e4-1272-4a1f-ba7e-b7ec7b341769 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:31.075137 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-57de95e4-1272-4a1f-ba7e-b7ec7b341769 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:31.290854 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-57de95e4-1272-4a1f-ba7e-b7ec7b341769 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:31.298816 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-57de95e4-1272-4a1f-ba7e-b7ec7b341769 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/99616012-21ed-48f0-a80e-e08de807a0f7" status: 200 len: 1279 microversion: 2.1 time: 0.237118 May 23 15:50:31.299496 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 484/932] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:50:31 2022] GET /compute/v2.1/servers/99616012-21ed-48f0-a80e-e08de807a0f7 => generated 1279 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:50:31.731935 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-1dd3bea1-173d-4661-b5cf-157e4474afd7 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a77f1e29-6790-47d5-a1b4-0175fbcce597", "device": "/dev/sdb"}} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:50:31.734934 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-1dd3bea1-173d-4661-b5cf-157e4474afd7 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] [instance: ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:50:31.741618 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1dd3bea1-173d-4661-b5cf-157e4474afd7 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:31.742105 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1dd3bea1-173d-4661-b5cf-157e4474afd7 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:31.743194 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1dd3bea1-173d-4661-b5cf-157e4474afd7 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:31.743643 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1dd3bea1-173d-4661-b5cf-157e4474afd7 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:31.749271 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [req-75d724b8-83dd-4029-b558-79d8f8422160 req-be1922f6-4397-41dc-bdc0-02164d0fc27d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99616012-21ed-48f0-a80e-e08de807a0f7", "tag": "94b34c73-13bd-4cd4-bab5-10d1f2fcdd65"}]} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:50:31.762476 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-75d724b8-83dd-4029-b558-79d8f8422160 req-be1922f6-4397-41dc-bdc0-02164d0fc27d service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:31.762919 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-75d724b8-83dd-4029-b558-79d8f8422160 req-be1922f6-4397-41dc-bdc0-02164d0fc27d service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:31.787775 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.compute.server_external_events [req-75d724b8-83dd-4029-b558-79d8f8422160 req-be1922f6-4397-41dc-bdc0-02164d0fc27d service nova] Creating event network-changed:94b34c73-13bd-4cd4-bab5-10d1f2fcdd65 for instance 99616012-21ed-48f0-a80e-e08de807a0f7 on hv-cinder-84067 May 23 15:50:31.795371 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [req-75d724b8-83dd-4029-b558-79d8f8422160 req-be1922f6-4397-41dc-bdc0-02164d0fc27d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052197 May 23 15:50:31.796417 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 485/933] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:50:32.326241 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-20a271f7-386c-491e-903f-11a277986944 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:50:32.326952 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-20a271f7-386c-491e-903f-11a277986944 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: 99616012-21ed-48f0-a80e-e08de807a0f7] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:50:32.333882 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-20a271f7-386c-491e-903f-11a277986944 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:32.334340 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-20a271f7-386c-491e-903f-11a277986944 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:32.335110 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-20a271f7-386c-491e-903f-11a277986944 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:32.335573 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-20a271f7-386c-491e-903f-11a277986944 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:32.431799 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-1dd3bea1-173d-4661-b5cf-157e4474afd7 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] 10.222.0.64 "POST /compute/v2.1/servers/ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.703935 May 23 15:50:32.432449 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 449/934] 10.222.0.64 () {60 vars in 1322 bytes} [Mon May 23 15:50:31 2022] POST /compute/v2.1/servers/ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e/os-volume_attachments => generated 194 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:50:32.544836 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-20a271f7-386c-491e-903f-11a277986944 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:32.552723 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-20a271f7-386c-491e-903f-11a277986944 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/99616012-21ed-48f0-a80e-e08de807a0f7" status: 200 len: 1267 microversion: 2.1 time: 0.230681 May 23 15:50:32.553332 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 486/935] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:50:32 2022] GET /compute/v2.1/servers/99616012-21ed-48f0-a80e-e08de807a0f7 => generated 1267 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:50:33.573106 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-898027bc-973f-4496-b1f6-6e50916f5ef5 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:50:33.573831 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-898027bc-973f-4496-b1f6-6e50916f5ef5 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: 99616012-21ed-48f0-a80e-e08de807a0f7] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:50:33.580315 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-898027bc-973f-4496-b1f6-6e50916f5ef5 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:33.580806 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-898027bc-973f-4496-b1f6-6e50916f5ef5 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:33.581623 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-898027bc-973f-4496-b1f6-6e50916f5ef5 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:33.582066 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-898027bc-973f-4496-b1f6-6e50916f5ef5 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:33.784816 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-898027bc-973f-4496-b1f6-6e50916f5ef5 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:33.792565 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-898027bc-973f-4496-b1f6-6e50916f5ef5 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/99616012-21ed-48f0-a80e-e08de807a0f7" status: 200 len: 1267 microversion: 2.1 time: 0.225194 May 23 15:50:33.793158 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 450/936] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:50:33 2022] GET /compute/v2.1/servers/99616012-21ed-48f0-a80e-e08de807a0f7 => generated 1267 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:50:34.810651 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-aa52feae-1596-417c-814a-219db810c251 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:50:34.811315 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-aa52feae-1596-417c-814a-219db810c251 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: 99616012-21ed-48f0-a80e-e08de807a0f7] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:50:34.817488 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-aa52feae-1596-417c-814a-219db810c251 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:34.817944 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-aa52feae-1596-417c-814a-219db810c251 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:34.818722 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-aa52feae-1596-417c-814a-219db810c251 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:34.819161 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-aa52feae-1596-417c-814a-219db810c251 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:34.952306 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-aa52feae-1596-417c-814a-219db810c251 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:34.959805 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-aa52feae-1596-417c-814a-219db810c251 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/99616012-21ed-48f0-a80e-e08de807a0f7" status: 200 len: 1267 microversion: 2.1 time: 0.153939 May 23 15:50:34.960363 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 487/937] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:50:34 2022] GET /compute/v2.1/servers/99616012-21ed-48f0-a80e-e08de807a0f7 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:50:35.976996 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-3d6ca1f1-2abb-450e-a0f5-ed3326078899 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:50:35.977561 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-3d6ca1f1-2abb-450e-a0f5-ed3326078899 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: 99616012-21ed-48f0-a80e-e08de807a0f7] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:50:35.984861 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-3d6ca1f1-2abb-450e-a0f5-ed3326078899 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:35.986428 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-3d6ca1f1-2abb-450e-a0f5-ed3326078899 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:35.986428 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-3d6ca1f1-2abb-450e-a0f5-ed3326078899 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:35.986832 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-3d6ca1f1-2abb-450e-a0f5-ed3326078899 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:36.126121 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-3d6ca1f1-2abb-450e-a0f5-ed3326078899 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:36.133388 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-3d6ca1f1-2abb-450e-a0f5-ed3326078899 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/99616012-21ed-48f0-a80e-e08de807a0f7" status: 200 len: 1267 microversion: 2.1 time: 0.160309 May 23 15:50:36.133949 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 451/938] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:50:35 2022] GET /compute/v2.1/servers/99616012-21ed-48f0-a80e-e08de807a0f7 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:50:37.151753 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-4733a198-3917-4e8e-a7e9-8113814dbc0a tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:50:37.152399 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-4733a198-3917-4e8e-a7e9-8113814dbc0a tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: 99616012-21ed-48f0-a80e-e08de807a0f7] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:50:37.158938 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4733a198-3917-4e8e-a7e9-8113814dbc0a tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:37.159396 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4733a198-3917-4e8e-a7e9-8113814dbc0a tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:37.160166 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4733a198-3917-4e8e-a7e9-8113814dbc0a tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:37.160608 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4733a198-3917-4e8e-a7e9-8113814dbc0a tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:37.289247 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-4733a198-3917-4e8e-a7e9-8113814dbc0a tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:37.297106 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-4733a198-3917-4e8e-a7e9-8113814dbc0a tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/99616012-21ed-48f0-a80e-e08de807a0f7" status: 200 len: 1267 microversion: 2.1 time: 0.149972 May 23 15:50:37.297664 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 488/939] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:50:37 2022] GET /compute/v2.1/servers/99616012-21ed-48f0-a80e-e08de807a0f7 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:50:38.314043 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-5ad895e9-7c17-4731-96cd-4a71943a9796 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:50:38.314663 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-5ad895e9-7c17-4731-96cd-4a71943a9796 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: 99616012-21ed-48f0-a80e-e08de807a0f7] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:50:38.317045 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_cell0:SELECT=2 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:50:38.317727 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_cell0:SELECT=6 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:50:38.323252 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-5ad895e9-7c17-4731-96cd-4a71943a9796 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:38.323705 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-5ad895e9-7c17-4731-96cd-4a71943a9796 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:38.324479 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-5ad895e9-7c17-4731-96cd-4a71943a9796 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:38.324919 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-5ad895e9-7c17-4731-96cd-4a71943a9796 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:38.461514 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-5ad895e9-7c17-4731-96cd-4a71943a9796 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:38.468899 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-5ad895e9-7c17-4731-96cd-4a71943a9796 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/99616012-21ed-48f0-a80e-e08de807a0f7" status: 200 len: 1267 microversion: 2.1 time: 0.158710 May 23 15:50:38.469485 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 452/940] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:50:38 2022] GET /compute/v2.1/servers/99616012-21ed-48f0-a80e-e08de807a0f7 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:50:39.486764 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-693d55a7-6b93-4e4a-b747-e31285df06b1 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:50:39.487476 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-693d55a7-6b93-4e4a-b747-e31285df06b1 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: 99616012-21ed-48f0-a80e-e08de807a0f7] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:50:39.489376 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_cell0:SELECT=2 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:50:39.495251 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-693d55a7-6b93-4e4a-b747-e31285df06b1 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:39.495700 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-693d55a7-6b93-4e4a-b747-e31285df06b1 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:39.496486 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-693d55a7-6b93-4e4a-b747-e31285df06b1 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:39.496918 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-693d55a7-6b93-4e4a-b747-e31285df06b1 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:39.639915 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-693d55a7-6b93-4e4a-b747-e31285df06b1 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:39.647360 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-693d55a7-6b93-4e4a-b747-e31285df06b1 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/99616012-21ed-48f0-a80e-e08de807a0f7" status: 200 len: 1267 microversion: 2.1 time: 0.164654 May 23 15:50:39.647871 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 489/941] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:50:39 2022] GET /compute/v2.1/servers/99616012-21ed-48f0-a80e-e08de807a0f7 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:50:40.665301 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-c7161b31-9bad-4619-9166-9bc8fc58969a tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:50:40.665946 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-c7161b31-9bad-4619-9166-9bc8fc58969a tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: 99616012-21ed-48f0-a80e-e08de807a0f7] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:50:40.672477 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c7161b31-9bad-4619-9166-9bc8fc58969a tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:40.672928 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c7161b31-9bad-4619-9166-9bc8fc58969a tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:40.673718 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c7161b31-9bad-4619-9166-9bc8fc58969a tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:40.674155 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c7161b31-9bad-4619-9166-9bc8fc58969a tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:40.810335 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-c7161b31-9bad-4619-9166-9bc8fc58969a tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:40.817768 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-c7161b31-9bad-4619-9166-9bc8fc58969a tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/99616012-21ed-48f0-a80e-e08de807a0f7" status: 200 len: 1267 microversion: 2.1 time: 0.156501 May 23 15:50:40.818330 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 453/942] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:50:40 2022] GET /compute/v2.1/servers/99616012-21ed-48f0-a80e-e08de807a0f7 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:50:41.836509 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-2a1507e7-da72-4760-83cf-c68199f57c73 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:50:41.837148 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-2a1507e7-da72-4760-83cf-c68199f57c73 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: 99616012-21ed-48f0-a80e-e08de807a0f7] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:50:41.844482 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2a1507e7-da72-4760-83cf-c68199f57c73 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:41.844934 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2a1507e7-da72-4760-83cf-c68199f57c73 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:41.845750 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2a1507e7-da72-4760-83cf-c68199f57c73 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:41.846180 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2a1507e7-da72-4760-83cf-c68199f57c73 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:41.987249 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-2a1507e7-da72-4760-83cf-c68199f57c73 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:41.995375 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-2a1507e7-da72-4760-83cf-c68199f57c73 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/99616012-21ed-48f0-a80e-e08de807a0f7" status: 200 len: 1267 microversion: 2.1 time: 0.163150 May 23 15:50:41.995977 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 490/943] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:50:41 2022] GET /compute/v2.1/servers/99616012-21ed-48f0-a80e-e08de807a0f7 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:50:43.013008 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-3503251a-d0de-4ced-a0ed-534dcbb71b29 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:50:43.013577 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-3503251a-d0de-4ced-a0ed-534dcbb71b29 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: 99616012-21ed-48f0-a80e-e08de807a0f7] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:50:43.019957 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-3503251a-d0de-4ced-a0ed-534dcbb71b29 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:43.020401 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-3503251a-d0de-4ced-a0ed-534dcbb71b29 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:43.021187 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-3503251a-d0de-4ced-a0ed-534dcbb71b29 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:43.021622 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-3503251a-d0de-4ced-a0ed-534dcbb71b29 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:43.149721 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-3503251a-d0de-4ced-a0ed-534dcbb71b29 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:43.157970 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-3503251a-d0de-4ced-a0ed-534dcbb71b29 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/99616012-21ed-48f0-a80e-e08de807a0f7" status: 200 len: 1267 microversion: 2.1 time: 0.149591 May 23 15:50:43.158524 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 454/944] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:50:43 2022] GET /compute/v2.1/servers/99616012-21ed-48f0-a80e-e08de807a0f7 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:50:44.175484 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-ffa43ef2-afe1-4698-9240-605c015604bb tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:50:44.176128 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-ffa43ef2-afe1-4698-9240-605c015604bb tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: 99616012-21ed-48f0-a80e-e08de807a0f7] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:50:44.182986 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ffa43ef2-afe1-4698-9240-605c015604bb tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:44.183443 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ffa43ef2-afe1-4698-9240-605c015604bb tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:44.184270 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ffa43ef2-afe1-4698-9240-605c015604bb tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:44.184714 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ffa43ef2-afe1-4698-9240-605c015604bb tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:44.320317 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-ffa43ef2-afe1-4698-9240-605c015604bb tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:44.328344 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-ffa43ef2-afe1-4698-9240-605c015604bb tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/99616012-21ed-48f0-a80e-e08de807a0f7" status: 200 len: 1267 microversion: 2.1 time: 0.156902 May 23 15:50:44.328756 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 491/945] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:50:44 2022] GET /compute/v2.1/servers/99616012-21ed-48f0-a80e-e08de807a0f7 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:50:45.345582 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-90528ab3-e354-4a25-a192-1499c5721fdc tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:50:45.346206 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-90528ab3-e354-4a25-a192-1499c5721fdc tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: 99616012-21ed-48f0-a80e-e08de807a0f7] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:50:45.352559 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-90528ab3-e354-4a25-a192-1499c5721fdc tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:45.353013 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-90528ab3-e354-4a25-a192-1499c5721fdc tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:45.355961 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-90528ab3-e354-4a25-a192-1499c5721fdc tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:45.356474 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-90528ab3-e354-4a25-a192-1499c5721fdc tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:45.495382 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-90528ab3-e354-4a25-a192-1499c5721fdc tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:45.502556 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-90528ab3-e354-4a25-a192-1499c5721fdc tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/99616012-21ed-48f0-a80e-e08de807a0f7" status: 200 len: 1267 microversion: 2.1 time: 0.160773 May 23 15:50:45.503125 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 455/946] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:50:45 2022] GET /compute/v2.1/servers/99616012-21ed-48f0-a80e-e08de807a0f7 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:50:46.520057 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-3cc58374-d6fe-4eae-a1c6-b7eb42af4d53 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:50:46.520666 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-3cc58374-d6fe-4eae-a1c6-b7eb42af4d53 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: 99616012-21ed-48f0-a80e-e08de807a0f7] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:50:46.527945 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3cc58374-d6fe-4eae-a1c6-b7eb42af4d53 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:46.528471 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3cc58374-d6fe-4eae-a1c6-b7eb42af4d53 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:46.529266 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3cc58374-d6fe-4eae-a1c6-b7eb42af4d53 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:46.538573 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3cc58374-d6fe-4eae-a1c6-b7eb42af4d53 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:46.673832 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-3cc58374-d6fe-4eae-a1c6-b7eb42af4d53 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:46.681364 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-3cc58374-d6fe-4eae-a1c6-b7eb42af4d53 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/99616012-21ed-48f0-a80e-e08de807a0f7" status: 200 len: 1267 microversion: 2.1 time: 0.165114 May 23 15:50:46.681919 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 492/947] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:50:46 2022] GET /compute/v2.1/servers/99616012-21ed-48f0-a80e-e08de807a0f7 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:50:47.698191 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-1fd6b1d0-4a8d-41e9-ac84-d8637692075c tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:50:47.699409 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-1fd6b1d0-4a8d-41e9-ac84-d8637692075c tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: 99616012-21ed-48f0-a80e-e08de807a0f7] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:50:47.705976 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1fd6b1d0-4a8d-41e9-ac84-d8637692075c tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:47.706420 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1fd6b1d0-4a8d-41e9-ac84-d8637692075c tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:47.707187 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1fd6b1d0-4a8d-41e9-ac84-d8637692075c tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:47.707619 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1fd6b1d0-4a8d-41e9-ac84-d8637692075c tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:47.835842 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-1fd6b1d0-4a8d-41e9-ac84-d8637692075c tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:47.843290 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-1fd6b1d0-4a8d-41e9-ac84-d8637692075c tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/99616012-21ed-48f0-a80e-e08de807a0f7" status: 200 len: 1267 microversion: 2.1 time: 0.149124 May 23 15:50:47.843844 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 456/948] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:50:47 2022] GET /compute/v2.1/servers/99616012-21ed-48f0-a80e-e08de807a0f7 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:50:48.860053 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-9db5dd9d-297d-4403-925f-1c201552e11d tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:50:48.860736 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-9db5dd9d-297d-4403-925f-1c201552e11d tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: 99616012-21ed-48f0-a80e-e08de807a0f7] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:50:48.867033 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-9db5dd9d-297d-4403-925f-1c201552e11d tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:48.867484 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-9db5dd9d-297d-4403-925f-1c201552e11d tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:48.868242 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-9db5dd9d-297d-4403-925f-1c201552e11d tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:48.868676 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-9db5dd9d-297d-4403-925f-1c201552e11d tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:48.998512 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-9db5dd9d-297d-4403-925f-1c201552e11d tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:49.006128 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-9db5dd9d-297d-4403-925f-1c201552e11d tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/99616012-21ed-48f0-a80e-e08de807a0f7" status: 200 len: 1267 microversion: 2.1 time: 0.149919 May 23 15:50:49.006688 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 493/949] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:50:48 2022] GET /compute/v2.1/servers/99616012-21ed-48f0-a80e-e08de807a0f7 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:50:50.023106 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-6cd693d8-3b1a-495e-9354-c0fe7397658f tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:50:50.023728 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-6cd693d8-3b1a-495e-9354-c0fe7397658f tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: 99616012-21ed-48f0-a80e-e08de807a0f7] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:50:50.030842 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-6cd693d8-3b1a-495e-9354-c0fe7397658f tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:50.031290 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-6cd693d8-3b1a-495e-9354-c0fe7397658f tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:50.032045 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-6cd693d8-3b1a-495e-9354-c0fe7397658f tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:50.032480 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-6cd693d8-3b1a-495e-9354-c0fe7397658f tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:50.162269 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-6cd693d8-3b1a-495e-9354-c0fe7397658f tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:50.170195 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-6cd693d8-3b1a-495e-9354-c0fe7397658f tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/99616012-21ed-48f0-a80e-e08de807a0f7" status: 200 len: 1267 microversion: 2.1 time: 0.150903 May 23 15:50:50.170749 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 457/950] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:50:50 2022] GET /compute/v2.1/servers/99616012-21ed-48f0-a80e-e08de807a0f7 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:50:51.027398 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [req-7deb834d-7a91-4efc-ac4f-75068cb2483f req-7ff79174-e026-40ea-81ca-32f5e2bdbe82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99616012-21ed-48f0-a80e-e08de807a0f7", "name": "network-vif-plugged", "status": "completed", "tag": "94b34c73-13bd-4cd4-bab5-10d1f2fcdd65"}]} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:50:51.036428 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-7deb834d-7a91-4efc-ac4f-75068cb2483f req-7ff79174-e026-40ea-81ca-32f5e2bdbe82 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:51.036886 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-7deb834d-7a91-4efc-ac4f-75068cb2483f req-7ff79174-e026-40ea-81ca-32f5e2bdbe82 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:51.048162 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.compute.server_external_events [req-7deb834d-7a91-4efc-ac4f-75068cb2483f req-7ff79174-e026-40ea-81ca-32f5e2bdbe82 service nova] Creating event network-vif-plugged:94b34c73-13bd-4cd4-bab5-10d1f2fcdd65 for instance 99616012-21ed-48f0-a80e-e08de807a0f7 on hv-cinder-84067 May 23 15:50:51.053701 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [req-7deb834d-7a91-4efc-ac4f-75068cb2483f req-7ff79174-e026-40ea-81ca-32f5e2bdbe82 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030138 May 23 15:50:51.054343 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 494/951] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:50:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:50:51.187731 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-f544e35f-dd52-4f2a-8edf-f8f33ad88a5b tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:50:51.188355 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-f544e35f-dd52-4f2a-8edf-f8f33ad88a5b tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: 99616012-21ed-48f0-a80e-e08de807a0f7] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:50:51.194788 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-f544e35f-dd52-4f2a-8edf-f8f33ad88a5b tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:51.195238 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-f544e35f-dd52-4f2a-8edf-f8f33ad88a5b tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:51.196063 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-f544e35f-dd52-4f2a-8edf-f8f33ad88a5b tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:51.196502 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-f544e35f-dd52-4f2a-8edf-f8f33ad88a5b tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:51.200505 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:50:51.332260 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-f544e35f-dd52-4f2a-8edf-f8f33ad88a5b tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:51.340240 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-f544e35f-dd52-4f2a-8edf-f8f33ad88a5b tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/99616012-21ed-48f0-a80e-e08de807a0f7" status: 200 len: 1267 microversion: 2.1 time: 0.157450 May 23 15:50:51.340803 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 458/952] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:50:51 2022] GET /compute/v2.1/servers/99616012-21ed-48f0-a80e-e08de807a0f7 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:50:52.358397 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-966a7703-e28e-4fc3-8e58-9d58d4d9e038 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:50:52.359051 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-966a7703-e28e-4fc3-8e58-9d58d4d9e038 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: 99616012-21ed-48f0-a80e-e08de807a0f7] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:50:52.365425 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-966a7703-e28e-4fc3-8e58-9d58d4d9e038 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:52.365892 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-966a7703-e28e-4fc3-8e58-9d58d4d9e038 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:52.366750 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-966a7703-e28e-4fc3-8e58-9d58d4d9e038 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:52.367208 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-966a7703-e28e-4fc3-8e58-9d58d4d9e038 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:52.372206 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_cell1:SELECT=91 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:50:52.502426 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-966a7703-e28e-4fc3-8e58-9d58d4d9e038 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:52.509940 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-966a7703-e28e-4fc3-8e58-9d58d4d9e038 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/99616012-21ed-48f0-a80e-e08de807a0f7" status: 200 len: 1267 microversion: 2.1 time: 0.156600 May 23 15:50:52.510492 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 495/953] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:50:52 2022] GET /compute/v2.1/servers/99616012-21ed-48f0-a80e-e08de807a0f7 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:50:53.527241 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-9ce31301-ac03-421d-8f09-4c1744cee5f7 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:50:53.528476 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-9ce31301-ac03-421d-8f09-4c1744cee5f7 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: 99616012-21ed-48f0-a80e-e08de807a0f7] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:50:53.531110 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:50:53.536252 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-9ce31301-ac03-421d-8f09-4c1744cee5f7 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:53.536702 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-9ce31301-ac03-421d-8f09-4c1744cee5f7 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:53.537510 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-9ce31301-ac03-421d-8f09-4c1744cee5f7 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:53.537954 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-9ce31301-ac03-421d-8f09-4c1744cee5f7 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:53.666189 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-9ce31301-ac03-421d-8f09-4c1744cee5f7 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:53.674192 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-9ce31301-ac03-421d-8f09-4c1744cee5f7 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/99616012-21ed-48f0-a80e-e08de807a0f7" status: 200 len: 1454 microversion: 2.1 time: 0.150878 May 23 15:50:53.675009 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 459/954] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:50:53 2022] GET /compute/v2.1/servers/99616012-21ed-48f0-a80e-e08de807a0f7 => generated 1454 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:50:53.691160 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-e32901b8-6985-485a-984b-be7b9130e761 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:50:53.691775 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-e32901b8-6985-485a-984b-be7b9130e761 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: 99616012-21ed-48f0-a80e-e08de807a0f7] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:50:53.698416 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e32901b8-6985-485a-984b-be7b9130e761 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:53.698870 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e32901b8-6985-485a-984b-be7b9130e761 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:53.699704 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e32901b8-6985-485a-984b-be7b9130e761 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:53.700664 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e32901b8-6985-485a-984b-be7b9130e761 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:53.836778 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-e32901b8-6985-485a-984b-be7b9130e761 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:50:53.845430 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-e32901b8-6985-485a-984b-be7b9130e761 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/99616012-21ed-48f0-a80e-e08de807a0f7" status: 200 len: 1454 microversion: 2.1 time: 0.158016 May 23 15:50:53.850295 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 496/955] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:50:53 2022] GET /compute/v2.1/servers/99616012-21ed-48f0-a80e-e08de807a0f7 => generated 1454 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:50:55.988388 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [req-c47397e4-8e95-4df2-935c-ff0df99d731e req-a31fc1a3-3b22-4d01-91b6-23ca95291424 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99616012-21ed-48f0-a80e-e08de807a0f7", "tag": "94b34c73-13bd-4cd4-bab5-10d1f2fcdd65"}]} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:50:55.996971 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-c47397e4-8e95-4df2-935c-ff0df99d731e req-a31fc1a3-3b22-4d01-91b6-23ca95291424 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:50:55.997475 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-c47397e4-8e95-4df2-935c-ff0df99d731e req-a31fc1a3-3b22-4d01-91b6-23ca95291424 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:50:56.009175 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.compute.server_external_events [req-c47397e4-8e95-4df2-935c-ff0df99d731e req-a31fc1a3-3b22-4d01-91b6-23ca95291424 service nova] Creating event network-changed:94b34c73-13bd-4cd4-bab5-10d1f2fcdd65 for instance 99616012-21ed-48f0-a80e-e08de807a0f7 on hv-cinder-84067 May 23 15:50:56.014762 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [req-c47397e4-8e95-4df2-935c-ff0df99d731e req-a31fc1a3-3b22-4d01-91b6-23ca95291424 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030116 May 23 15:50:56.015353 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 460/956] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:50:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:51:03.147977 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-2a77e72b-d336-4406-8c0b-917db5bf4b58 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:03.148606 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-2a77e72b-d336-4406-8c0b-917db5bf4b58 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] [instance: ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:03.151168 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_api:SELECT=42 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:51:03.156726 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2a77e72b-d336-4406-8c0b-917db5bf4b58 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:03.157217 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2a77e72b-d336-4406-8c0b-917db5bf4b58 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:03.157992 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2a77e72b-d336-4406-8c0b-917db5bf4b58 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:03.158440 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2a77e72b-d336-4406-8c0b-917db5bf4b58 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:03.239187 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.objects.instance [None req-2a77e72b-d336-4406-8c0b-917db5bf4b58 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lazy-loading 'services' on Instance uuid ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e {{(pid=124934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 15:51:03.443871 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-2a77e72b-d336-4406-8c0b-917db5bf4b58 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] 10.222.0.64 "DELETE /compute/v2.1/servers/ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e/os-volume_attachments/a77f1e29-6790-47d5-a1b4-0175fbcce597" status: 202 len: 0 microversion: 2.1 time: 0.299916 May 23 15:51:03.444886 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 497/957] 10.222.0.64 () {58 vars in 1415 bytes} [Mon May 23 15:51:03 2022] DELETE /compute/v2.1/servers/ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e/os-volume_attachments/a77f1e29-6790-47d5-a1b4-0175fbcce597 => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 15:51:05.664242 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-cfa6be23-fe04-4c15-b741-5469a44ac8dd tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:05.664828 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-cfa6be23-fe04-4c15-b741-5469a44ac8dd tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] [instance: ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:05.671897 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-cfa6be23-fe04-4c15-b741-5469a44ac8dd tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:05.672350 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-cfa6be23-fe04-4c15-b741-5469a44ac8dd tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:05.673159 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-cfa6be23-fe04-4c15-b741-5469a44ac8dd tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:05.673599 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-cfa6be23-fe04-4c15-b741-5469a44ac8dd tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:05.698330 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-cfa6be23-fe04-4c15-b741-5469a44ac8dd tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] [instance: ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e] Going to try to terminate instance {{(pid=124933) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 15:51:06.026504 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-cfa6be23-fe04-4c15-b741-5469a44ac8dd tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] 10.222.0.64 "DELETE /compute/v2.1/servers/ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e" status: 204 len: 0 microversion: 2.1 time: 0.366100 May 23 15:51:06.031522 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 461/958] 10.222.0.64 () {58 vars in 1238 bytes} [Mon May 23 15:51:05 2022] DELETE /compute/v2.1/servers/ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 23 15:51:06.036719 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-19d03617-ecc2-4a15-b979-0bd357178e82 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:06.037452 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-19d03617-ecc2-4a15-b979-0bd357178e82 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] [instance: ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:06.044100 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-19d03617-ecc2-4a15-b979-0bd357178e82 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:06.044555 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-19d03617-ecc2-4a15-b979-0bd357178e82 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:06.045360 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-19d03617-ecc2-4a15-b979-0bd357178e82 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:06.045804 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-19d03617-ecc2-4a15-b979-0bd357178e82 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:06.180687 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-19d03617-ecc2-4a15-b979-0bd357178e82 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c14e93cced14b1b95e2de8fedce31e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c0e4fa5fa246f08bb61703a42e2c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:06.188307 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-19d03617-ecc2-4a15-b979-0bd357178e82 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] 10.222.0.64 "GET /compute/v2.1/servers/ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e" status: 200 len: 1512 microversion: 2.1 time: 0.155777 May 23 15:51:06.188873 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 498/959] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:51:06 2022] GET /compute/v2.1/servers/ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:51:07.205570 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-c1be7cae-1455-4ac3-bbb6-d650c9a6cd81 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:07.206310 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-c1be7cae-1455-4ac3-bbb6-d650c9a6cd81 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] [instance: ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:07.214200 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c1be7cae-1455-4ac3-bbb6-d650c9a6cd81 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:07.214646 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c1be7cae-1455-4ac3-bbb6-d650c9a6cd81 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:07.215439 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c1be7cae-1455-4ac3-bbb6-d650c9a6cd81 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:07.215877 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c1be7cae-1455-4ac3-bbb6-d650c9a6cd81 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:07.345538 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-c1be7cae-1455-4ac3-bbb6-d650c9a6cd81 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c14e93cced14b1b95e2de8fedce31e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c0e4fa5fa246f08bb61703a42e2c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:07.353047 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-c1be7cae-1455-4ac3-bbb6-d650c9a6cd81 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] 10.222.0.64 "GET /compute/v2.1/servers/ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e" status: 200 len: 1512 microversion: 2.1 time: 0.151818 May 23 15:51:07.353629 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 462/960] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:51:07 2022] GET /compute/v2.1/servers/ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:51:08.370797 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-4e75911b-1ddd-42c0-b532-a36393fa601b tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:08.371543 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-4e75911b-1ddd-42c0-b532-a36393fa601b tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] [instance: ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:08.378105 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4e75911b-1ddd-42c0-b532-a36393fa601b tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:08.378697 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4e75911b-1ddd-42c0-b532-a36393fa601b tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:08.379550 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4e75911b-1ddd-42c0-b532-a36393fa601b tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:08.380000 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-4e75911b-1ddd-42c0-b532-a36393fa601b tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:08.569853 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-4e75911b-1ddd-42c0-b532-a36393fa601b tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c14e93cced14b1b95e2de8fedce31e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c0e4fa5fa246f08bb61703a42e2c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:08.577543 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-4e75911b-1ddd-42c0-b532-a36393fa601b tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] 10.222.0.64 "GET /compute/v2.1/servers/ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e" status: 200 len: 1512 microversion: 2.1 time: 0.210638 May 23 15:51:08.578113 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 499/961] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:51:08 2022] GET /compute/v2.1/servers/ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e => generated 1512 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:51:08.680561 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [req-d6ec7708-d3a1-40d6-99aa-54539f50e277 req-83c1584c-685f-4224-9e52-f90104a36bed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e", "name": "network-vif-deleted", "tag": "e4eaecf3-0ea6-488b-9f92-86de045b6736"}]} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:51:08.690133 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-d6ec7708-d3a1-40d6-99aa-54539f50e277 req-83c1584c-685f-4224-9e52-f90104a36bed service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:08.690575 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-d6ec7708-d3a1-40d6-99aa-54539f50e277 req-83c1584c-685f-4224-9e52-f90104a36bed service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:08.701715 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.compute.server_external_events [req-d6ec7708-d3a1-40d6-99aa-54539f50e277 req-83c1584c-685f-4224-9e52-f90104a36bed service nova] Creating event network-vif-deleted:e4eaecf3-0ea6-488b-9f92-86de045b6736 for instance ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e on hv-cinder-84067 May 23 15:51:08.710081 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [req-d6ec7708-d3a1-40d6-99aa-54539f50e277 req-83c1584c-685f-4224-9e52-f90104a36bed service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033068 May 23 15:51:08.710841 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 463/962] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:51:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:51:09.599443 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-7aa2946e-7d25-43c1-bcd6-b9d19421c5d6 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:09.602817 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-7aa2946e-7d25-43c1-bcd6-b9d19421c5d6 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] [instance: ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:09.606553 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-7aa2946e-7d25-43c1-bcd6-b9d19421c5d6 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:09.606987 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-7aa2946e-7d25-43c1-bcd6-b9d19421c5d6 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:09.607771 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-7aa2946e-7d25-43c1-bcd6-b9d19421c5d6 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:09.608214 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-7aa2946e-7d25-43c1-bcd6-b9d19421c5d6 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:09.639916 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-7aa2946e-7d25-43c1-bcd6-b9d19421c5d6 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:09.640380 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-7aa2946e-7d25-43c1-bcd6-b9d19421c5d6 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:09.640878 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.objects.instance [None req-7aa2946e-7d25-43c1-bcd6-b9d19421c5d6 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lazy-loading 'fault' on Instance uuid ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e {{(pid=124934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 15:51:09.683048 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-7aa2946e-7d25-43c1-bcd6-b9d19421c5d6 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c14e93cced14b1b95e2de8fedce31e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c0e4fa5fa246f08bb61703a42e2c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:09.690466 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-7aa2946e-7d25-43c1-bcd6-b9d19421c5d6 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] 10.222.0.64 "GET /compute/v2.1/servers/ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e" status: 200 len: 1308 microversion: 2.1 time: 0.098834 May 23 15:51:09.691030 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 500/963] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:51:09 2022] GET /compute/v2.1/servers/ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e => generated 1308 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:51:10.708216 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-cc57a772-28c2-4980-be78-367cb7899f1d tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:10.709522 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-cc57a772-28c2-4980-be78-367cb7899f1d tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] [instance: ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:10.716628 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-cc57a772-28c2-4980-be78-367cb7899f1d tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:10.717104 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-cc57a772-28c2-4980-be78-367cb7899f1d tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:10.717873 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-cc57a772-28c2-4980-be78-367cb7899f1d tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:10.718346 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-cc57a772-28c2-4980-be78-367cb7899f1d tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:10.732481 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.wsgi [None req-cc57a772-28c2-4980-be78-367cb7899f1d tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] HTTP exception thrown: Instance ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e could not be found. May 23 15:51:10.734137 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-cc57a772-28c2-4980-be78-367cb7899f1d tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Request method failure captured: May 23 15:51:10.734137 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: request: GET /compute/v2.1/servers/ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e HTTP/1.1 May 23 15:51:10.734137 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Accept: application/json May 23 15:51:10.734137 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Accept-Encoding: identity May 23 15:51:10.734137 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Connection: close May 23 15:51:10.734137 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Content-Length: 0 May 23 15:51:10.734137 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Content-Type: application/json May 23 15:51:10.734137 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Host: 10.222.0.64 May 23 15:51:10.734137 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Openstack-System-Scope: None May 23 15:51:10.734137 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: User-Agent: python-urllib3/1.26.9 May 23 15:51:10.734137 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Auth-Token: gAAAAABii60h69bDdN3odUc6LMSCZvlxEO3cMO1-YvoJdrJYCG6O2UnbR44sSu2mKj0BNzFwu3sSVuDdqY18TUZTzo_8J4xMORS7RcZyPsUMg9LJcLgWU1gVmgz75dCNa7pusoRHt1D-pHNjXQqRJrpB3D5xKCQmXKBfWPGR_XyxVWl6glPRkMI May 23 15:51:10.734137 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Domain-Id: None May 23 15:51:10.734137 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Domain-Name: None May 23 15:51:10.734137 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Identity-Status: Confirmed May 23 15:51:10.734137 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Is-Admin-Project: True May 23 15:51:10.734137 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Domain-Id: default May 23 15:51:10.734137 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Domain-Name: Default May 23 15:51:10.734137 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Id: 58c0e4fa5fa246f08bb61703a42e2c59 May 23 15:51:10.734137 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Name: tempest-VolumesSnapshotTestJSON-833324563 May 23 15:51:10.734137 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Role: reader,member May 23 15:51:10.734137 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Roles: reader,member May 23 15:51:10.736604 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/58c0e4fa5fa246f08bb61703a42e2c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/58c0e4fa5fa246f08bb61703a42e2c59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/58c0e4fa5fa246f08bb61703a42e2c59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_58c0e4fa5fa246f08bb61703a42e2c59", "adminURL": "http://10.222.0.64:8080"}]}] May 23 15:51:10.736604 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant: tempest-VolumesSnapshotTestJSON-833324563 May 23 15:51:10.736604 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant-Id: 58c0e4fa5fa246f08bb61703a42e2c59 May 23 15:51:10.736604 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-833324563 May 23 15:51:10.736604 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User: tempest-VolumesSnapshotTestJSON-833324563-project May 23 15:51:10.736604 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Domain-Id: default May 23 15:51:10.736604 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Domain-Name: Default May 23 15:51:10.736604 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Id: 6c14e93cced14b1b95e2de8fedce31e8 May 23 15:51:10.736604 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Name: tempest-VolumesSnapshotTestJSON-833324563-project May 23 15:51:10.736604 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: method: > May 23 15:51:10.736604 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: exception: Instance ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e could not be found. May 23 15:51:10.736604 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: action_args: {'id': 'ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e'} May 23 15:51:10.737559 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:51:10.737559 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:51:10.737559 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:51:10.737559 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:51:10.737559 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:51:10.737559 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:51:10.737559 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:51:10.737559 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:51:10.737559 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:51:10.737559 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:51:10.737559 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e could not be found. May 23 15:51:10.737559 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:51:10.737559 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:51:10.737559 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:51:10.737559 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:51:10.737559 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:51:10.737559 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:51:10.737559 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:51:10.737559 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:51:10.737559 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:51:10.738925 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:51:10.738925 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 15:51:10.738925 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 15:51:10.738925 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:51:10.738925 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:51:10.738925 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:51:10.738925 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:51:10.738925 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e could not be found. May 23 15:51:10.738925 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:51:10.738925 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:51:10.738925 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:51:10.738925 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:51:10.738925 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:51:10.738925 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:51:10.738925 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:51:10.738925 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:51:10.738925 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e could not be found. May 23 15:51:10.738925 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:51:10.740157 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-cc57a772-28c2-4980-be78-367cb7899f1d tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Returning 404 to user: Instance ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e could not be found. {{(pid=124933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:51:10.740157 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-cc57a772-28c2-4980-be78-367cb7899f1d tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] 10.222.0.64 "GET /compute/v2.1/servers/ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e" status: 404 len: 111 microversion: 2.1 time: 0.031672 May 23 15:51:10.740157 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 464/964] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:51:10 2022] GET /compute/v2.1/servers/ca9507bf-1557-4d9b-a344-c9f3a8ff8f6e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 15:51:11.682216 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-16490607-194a-4219-a487-08fc770bc8f0 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-112560903", "imageRef": "a5c8503f-3733-426f-8a5b-c7c9358e4a45", "flavorRef": "452"}} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:51:11.732055 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.network.neutron [None req-16490607-194a-4219-a487-08fc770bc8f0 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] validate_networks() for None {{(pid=124934) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 15:51:12.005824 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.virt.hardware [None req-16490607-194a-4219-a487-08fc770bc8f0 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Flavor limits 0:0:0 {{(pid=124934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 15:51:12.006248 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.virt.hardware [None req-16490607-194a-4219-a487-08fc770bc8f0 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Image limits 0:0:0 {{(pid=124934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 15:51:12.006791 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.virt.hardware [None req-16490607-194a-4219-a487-08fc770bc8f0 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Flavor pref 0:0:0 {{(pid=124934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 15:51:12.007177 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.virt.hardware [None req-16490607-194a-4219-a487-08fc770bc8f0 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Image pref 0:0:0 {{(pid=124934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 15:51:12.007588 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.virt.hardware [None req-16490607-194a-4219-a487-08fc770bc8f0 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 15:51:12.016574 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-16490607-194a-4219-a487-08fc770bc8f0 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:12.017193 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-16490607-194a-4219-a487-08fc770bc8f0 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:12.017869 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-16490607-194a-4219-a487-08fc770bc8f0 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:12.018424 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-16490607-194a-4219-a487-08fc770bc8f0 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:12.034792 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.quota [None req-16490607-194a-4219-a487-08fc770bc8f0 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Getting quotas for project 4c1b36ef4dfe4aab851fe6c0d2680fe0. Resources: {'ram', 'instances', 'cores'} {{(pid=124934) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 15:51:12.038769 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.quota [None req-16490607-194a-4219-a487-08fc770bc8f0 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Getting quotas for user 3cb19028337347329f21f278df8e98a7 and project 4c1b36ef4dfe4aab851fe6c0d2680fe0. Resources: {'ram', 'instances', 'cores'} {{(pid=124934) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 15:51:12.050435 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-16490607-194a-4219-a487-08fc770bc8f0 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Going to run 1 instances... {{(pid=124934) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 15:51:12.052645 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-16490607-194a-4219-a487-08fc770bc8f0 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] [instance: 9c9f81be-b2c5-43c5-9640-3055f570b6b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5c8503f-3733-426f-8a5b-c7c9358e4a45',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124934) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 15:51:12.150735 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-16490607-194a-4219-a487-08fc770bc8f0 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.472311 May 23 15:51:12.151650 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 501/965] 10.222.0.64 () {60 vars in 1146 bytes} [Mon May 23 15:51:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 474 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 15:51:12.161823 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-55028cad-05a5-4251-9baa-676834887e6a tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:12.162523 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-55028cad-05a5-4251-9baa-676834887e6a tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] [instance: 9c9f81be-b2c5-43c5-9640-3055f570b6b4] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:12.231884 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-55028cad-05a5-4251-9baa-676834887e6a tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb19028337347329f21f278df8e98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1b36ef4dfe4aab851fe6c0d2680fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:12.240003 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-55028cad-05a5-4251-9baa-676834887e6a tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] 10.222.0.64 "GET /compute/v2.1/servers/9c9f81be-b2c5-43c5-9640-3055f570b6b4" status: 200 len: 1214 microversion: 2.1 time: 0.082405 May 23 15:51:12.240556 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 465/966] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:51:12 2022] GET /compute/v2.1/servers/9c9f81be-b2c5-43c5-9640-3055f570b6b4 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:51:13.257774 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-f3a984e6-5dd6-46b8-974d-5202c641cbe6 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:13.259458 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-f3a984e6-5dd6-46b8-974d-5202c641cbe6 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] [instance: 9c9f81be-b2c5-43c5-9640-3055f570b6b4] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:13.267919 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-f3a984e6-5dd6-46b8-974d-5202c641cbe6 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:13.268366 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-f3a984e6-5dd6-46b8-974d-5202c641cbe6 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:13.269155 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-f3a984e6-5dd6-46b8-974d-5202c641cbe6 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:13.269703 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-f3a984e6-5dd6-46b8-974d-5202c641cbe6 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:13.330291 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-f3a984e6-5dd6-46b8-974d-5202c641cbe6 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb19028337347329f21f278df8e98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1b36ef4dfe4aab851fe6c0d2680fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:13.337682 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-f3a984e6-5dd6-46b8-974d-5202c641cbe6 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] 10.222.0.64 "GET /compute/v2.1/servers/9c9f81be-b2c5-43c5-9640-3055f570b6b4" status: 200 len: 1218 microversion: 2.1 time: 0.083800 May 23 15:51:13.338226 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 502/967] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:51:13 2022] GET /compute/v2.1/servers/9c9f81be-b2c5-43c5-9640-3055f570b6b4 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:51:14.355229 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-19cee16c-9825-4c75-8c85-3a2c19431b5a tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:14.355976 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-19cee16c-9825-4c75-8c85-3a2c19431b5a tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] [instance: 9c9f81be-b2c5-43c5-9640-3055f570b6b4] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:14.362957 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-19cee16c-9825-4c75-8c85-3a2c19431b5a tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:14.363432 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-19cee16c-9825-4c75-8c85-3a2c19431b5a tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:14.364197 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-19cee16c-9825-4c75-8c85-3a2c19431b5a tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:14.364634 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-19cee16c-9825-4c75-8c85-3a2c19431b5a tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:14.429936 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-19cee16c-9825-4c75-8c85-3a2c19431b5a tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb19028337347329f21f278df8e98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1b36ef4dfe4aab851fe6c0d2680fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:14.437621 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-19cee16c-9825-4c75-8c85-3a2c19431b5a tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] 10.222.0.64 "GET /compute/v2.1/servers/9c9f81be-b2c5-43c5-9640-3055f570b6b4" status: 200 len: 1218 microversion: 2.1 time: 0.086999 May 23 15:51:14.438185 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 466/968] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:51:14 2022] GET /compute/v2.1/servers/9c9f81be-b2c5-43c5-9640-3055f570b6b4 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:51:15.315813 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-84fc74af-b53f-458e-8edc-5626ba068d02 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:15.315813 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-84fc74af-b53f-458e-8edc-5626ba068d02 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:15.321743 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-84fc74af-b53f-458e-8edc-5626ba068d02 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:15.322288 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-84fc74af-b53f-458e-8edc-5626ba068d02 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:15.323067 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-84fc74af-b53f-458e-8edc-5626ba068d02 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:15.323549 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-84fc74af-b53f-458e-8edc-5626ba068d02 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:15.346716 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-84fc74af-b53f-458e-8edc-5626ba068d02 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305/ips" status: 200 len: 150 microversion: 2.20 time: 0.036372 May 23 15:51:15.347265 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 503/969] 10.222.0.64 () {60 vars in 1288 bytes} [Mon May 23 15:51:15 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 15:51:15.455342 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-2c81d9ae-6f80-4db9-a519-775f5fe6aca1 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:15.455863 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-2c81d9ae-6f80-4db9-a519-775f5fe6aca1 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] [instance: 9c9f81be-b2c5-43c5-9640-3055f570b6b4] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:15.462328 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-2c81d9ae-6f80-4db9-a519-775f5fe6aca1 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:15.463017 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-2c81d9ae-6f80-4db9-a519-775f5fe6aca1 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:15.463856 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-2c81d9ae-6f80-4db9-a519-775f5fe6aca1 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:15.464297 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-2c81d9ae-6f80-4db9-a519-775f5fe6aca1 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:15.552212 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-2c81d9ae-6f80-4db9-a519-775f5fe6aca1 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb19028337347329f21f278df8e98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1b36ef4dfe4aab851fe6c0d2680fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:15.559046 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-2c81d9ae-6f80-4db9-a519-775f5fe6aca1 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] 10.222.0.64 "GET /compute/v2.1/servers/9c9f81be-b2c5-43c5-9640-3055f570b6b4" status: 200 len: 1274 microversion: 2.1 time: 0.107934 May 23 15:51:15.559621 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 467/970] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:51:15 2022] GET /compute/v2.1/servers/9c9f81be-b2c5-43c5-9640-3055f570b6b4 => generated 1274 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:51:16.575778 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-69e0a8ca-30d6-469f-87dd-7edd20ba8408 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:16.576406 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-69e0a8ca-30d6-469f-87dd-7edd20ba8408 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] [instance: 9c9f81be-b2c5-43c5-9640-3055f570b6b4] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:16.583304 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-69e0a8ca-30d6-469f-87dd-7edd20ba8408 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:16.583766 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-69e0a8ca-30d6-469f-87dd-7edd20ba8408 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:16.594683 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-69e0a8ca-30d6-469f-87dd-7edd20ba8408 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:16.594683 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-69e0a8ca-30d6-469f-87dd-7edd20ba8408 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:16.773004 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-69e0a8ca-30d6-469f-87dd-7edd20ba8408 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb19028337347329f21f278df8e98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1b36ef4dfe4aab851fe6c0d2680fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:16.780755 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-69e0a8ca-30d6-469f-87dd-7edd20ba8408 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] 10.222.0.64 "GET /compute/v2.1/servers/9c9f81be-b2c5-43c5-9640-3055f570b6b4" status: 200 len: 1314 microversion: 2.1 time: 0.208933 May 23 15:51:16.790976 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 504/971] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:51:16 2022] GET /compute/v2.1/servers/9c9f81be-b2c5-43c5-9640-3055f570b6b4 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:51:17.501800 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [req-885f6a11-0b13-47e9-bdc4-51b0a43ae3ca req-206db94f-8dd4-4546-b73c-f4d8cbe1c30c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c9f81be-b2c5-43c5-9640-3055f570b6b4", "tag": "a39c2919-e340-4c48-81ee-27fdb345a133"}]} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:51:17.511796 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-885f6a11-0b13-47e9-bdc4-51b0a43ae3ca req-206db94f-8dd4-4546-b73c-f4d8cbe1c30c service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:17.512591 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-885f6a11-0b13-47e9-bdc4-51b0a43ae3ca req-206db94f-8dd4-4546-b73c-f4d8cbe1c30c service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:17.527453 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.compute.server_external_events [req-885f6a11-0b13-47e9-bdc4-51b0a43ae3ca req-206db94f-8dd4-4546-b73c-f4d8cbe1c30c service nova] Creating event network-changed:a39c2919-e340-4c48-81ee-27fdb345a133 for instance 9c9f81be-b2c5-43c5-9640-3055f570b6b4 on hv-cinder-84067 May 23 15:51:17.532932 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [req-885f6a11-0b13-47e9-bdc4-51b0a43ae3ca req-206db94f-8dd4-4546-b73c-f4d8cbe1c30c service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036637 May 23 15:51:17.533568 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 468/972] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:51:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:51:17.798736 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-24e7df00-69a2-46c3-a4cb-b28651fc6f2d tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:17.799361 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-24e7df00-69a2-46c3-a4cb-b28651fc6f2d tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] [instance: 9c9f81be-b2c5-43c5-9640-3055f570b6b4] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:17.806070 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-24e7df00-69a2-46c3-a4cb-b28651fc6f2d tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:17.806533 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-24e7df00-69a2-46c3-a4cb-b28651fc6f2d tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:17.807306 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-24e7df00-69a2-46c3-a4cb-b28651fc6f2d tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:17.807752 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-24e7df00-69a2-46c3-a4cb-b28651fc6f2d tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:17.940284 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-24e7df00-69a2-46c3-a4cb-b28651fc6f2d tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb19028337347329f21f278df8e98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1b36ef4dfe4aab851fe6c0d2680fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:17.947929 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-24e7df00-69a2-46c3-a4cb-b28651fc6f2d tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] 10.222.0.64 "GET /compute/v2.1/servers/9c9f81be-b2c5-43c5-9640-3055f570b6b4" status: 200 len: 1314 microversion: 2.1 time: 0.153144 May 23 15:51:17.948502 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 505/973] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:51:17 2022] GET /compute/v2.1/servers/9c9f81be-b2c5-43c5-9640-3055f570b6b4 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:51:18.295169 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-46ad08a2-0f5c-4a36-bf68-878457c81e88 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:51:18.295816 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-46ad08a2-0f5c-4a36-bf68-878457c81e88 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:18.303017 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-46ad08a2-0f5c-4a36-bf68-878457c81e88 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:18.303464 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-46ad08a2-0f5c-4a36-bf68-878457c81e88 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:18.304219 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-46ad08a2-0f5c-4a36-bf68-878457c81e88 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:18.304658 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-46ad08a2-0f5c-4a36-bf68-878457c81e88 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:18.326598 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.objects.instance [None req-46ad08a2-0f5c-4a36-bf68-878457c81e88 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lazy-loading 'flavor' on Instance uuid 6e0a2baa-19d3-46f7-8585-c5272f971305 {{(pid=124933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 15:51:18.934630 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-46ad08a2-0f5c-4a36-bf68-878457c81e88 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "POST /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305/action" status: 202 len: 0 microversion: 2.20 time: 0.643446 May 23 15:51:18.935239 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 469/974] 10.222.0.64 () {62 vars in 1318 bytes} [Mon May 23 15:51:18 2022] POST /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305/action => generated 0 bytes in 645 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 23 15:51:18.943332 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-98d23b70-58f2-4259-a155-a0e9a7ce1f12 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:18.950970 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-98d23b70-58f2-4259-a155-a0e9a7ce1f12 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:18.950970 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-98d23b70-58f2-4259-a155-a0e9a7ce1f12 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:18.950970 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-98d23b70-58f2-4259-a155-a0e9a7ce1f12 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:18.951282 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-98d23b70-58f2-4259-a155-a0e9a7ce1f12 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:18.951657 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-98d23b70-58f2-4259-a155-a0e9a7ce1f12 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:18.965431 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-1465e388-8aaf-4fa3-975e-e35819ef62f3 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:18.966148 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-1465e388-8aaf-4fa3-975e-e35819ef62f3 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] [instance: 9c9f81be-b2c5-43c5-9640-3055f570b6b4] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:18.973189 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1465e388-8aaf-4fa3-975e-e35819ef62f3 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:18.977655 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1465e388-8aaf-4fa3-975e-e35819ef62f3 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:18.977655 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1465e388-8aaf-4fa3-975e-e35819ef62f3 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:18.977655 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1465e388-8aaf-4fa3-975e-e35819ef62f3 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:19.151503 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-98d23b70-58f2-4259-a155-a0e9a7ce1f12 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:19.164900 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-1465e388-8aaf-4fa3-975e-e35819ef62f3 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb19028337347329f21f278df8e98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1b36ef4dfe4aab851fe6c0d2680fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:19.165101 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-98d23b70-58f2-4259-a155-a0e9a7ce1f12 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:19.165101 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-98d23b70-58f2-4259-a155-a0e9a7ce1f12 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:19.165101 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-98d23b70-58f2-4259-a155-a0e9a7ce1f12 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305" status: 200 len: 1720 microversion: 2.20 time: 0.223252 May 23 15:51:19.165435 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 506/975] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:51:18 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 => generated 1720 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:51:19.167111 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-1465e388-8aaf-4fa3-975e-e35819ef62f3 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] 10.222.0.64 "GET /compute/v2.1/servers/9c9f81be-b2c5-43c5-9640-3055f570b6b4" status: 200 len: 1314 microversion: 2.1 time: 0.205987 May 23 15:51:19.167665 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 470/976] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:51:18 2022] GET /compute/v2.1/servers/9c9f81be-b2c5-43c5-9640-3055f570b6b4 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:51:20.181689 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-c50582ef-0fae-427f-9a9d-7c66451f3d8a tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:20.182402 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-c50582ef-0fae-427f-9a9d-7c66451f3d8a tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:20.184073 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-f0fd01d7-acda-479c-baf5-2920c46fac0f tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:20.184588 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-f0fd01d7-acda-479c-baf5-2920c46fac0f tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] [instance: 9c9f81be-b2c5-43c5-9640-3055f570b6b4] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:20.189381 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-c50582ef-0fae-427f-9a9d-7c66451f3d8a tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:20.189973 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-c50582ef-0fae-427f-9a9d-7c66451f3d8a tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:20.190859 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-c50582ef-0fae-427f-9a9d-7c66451f3d8a tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:20.191423 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-c50582ef-0fae-427f-9a9d-7c66451f3d8a tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:20.191633 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-f0fd01d7-acda-479c-baf5-2920c46fac0f tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:20.192094 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-f0fd01d7-acda-479c-baf5-2920c46fac0f tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:20.192979 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-f0fd01d7-acda-479c-baf5-2920c46fac0f tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:20.193457 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-f0fd01d7-acda-479c-baf5-2920c46fac0f tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:20.462552 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-c50582ef-0fae-427f-9a9d-7c66451f3d8a tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:20.468220 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-f0fd01d7-acda-479c-baf5-2920c46fac0f tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb19028337347329f21f278df8e98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1b36ef4dfe4aab851fe6c0d2680fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:20.472388 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-c50582ef-0fae-427f-9a9d-7c66451f3d8a tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:20.473961 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-c50582ef-0fae-427f-9a9d-7c66451f3d8a tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:20.475254 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-c50582ef-0fae-427f-9a9d-7c66451f3d8a tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305" status: 200 len: 1720 microversion: 2.20 time: 0.297450 May 23 15:51:20.475814 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 507/977] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:51:20 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 => generated 1720 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:51:20.478694 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-f0fd01d7-acda-479c-baf5-2920c46fac0f tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] 10.222.0.64 "GET /compute/v2.1/servers/9c9f81be-b2c5-43c5-9640-3055f570b6b4" status: 200 len: 1314 microversion: 2.1 time: 0.298612 May 23 15:51:20.479461 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 471/978] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:51:20 2022] GET /compute/v2.1/servers/9c9f81be-b2c5-43c5-9640-3055f570b6b4 => generated 1314 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:51:21.154743 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-bcb1abe7-3e36-45dd-aa8c-3b9bb242b50c tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1422343804", "imageRef": "a5c8503f-3733-426f-8a5b-c7c9358e4a45", "flavorRef": "452", "networks": [{"uuid": "463d1c0a-9c63-4f99-9c4a-599a01360208"}]}} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:51:21.204702 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.network.neutron [None req-bcb1abe7-3e36-45dd-aa8c-3b9bb242b50c tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] validate_networks() for [('463d1c0a-9c63-4f99-9c4a-599a01360208', None, None, None, None, None)] {{(pid=124934) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 15:51:21.494383 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-7fc09491-291d-4b38-8afb-79e981657a33 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:21.494991 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-7fc09491-291d-4b38-8afb-79e981657a33 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:21.501565 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-7fc09491-291d-4b38-8afb-79e981657a33 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:21.502010 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-7fc09491-291d-4b38-8afb-79e981657a33 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:21.502782 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-7fc09491-291d-4b38-8afb-79e981657a33 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:21.503219 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-7fc09491-291d-4b38-8afb-79e981657a33 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:21.798418 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.virt.hardware [None req-bcb1abe7-3e36-45dd-aa8c-3b9bb242b50c tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Flavor limits 0:0:0 {{(pid=124934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 15:51:21.798879 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.virt.hardware [None req-bcb1abe7-3e36-45dd-aa8c-3b9bb242b50c tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Image limits 0:0:0 {{(pid=124934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 15:51:21.799365 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.virt.hardware [None req-bcb1abe7-3e36-45dd-aa8c-3b9bb242b50c tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Flavor pref 0:0:0 {{(pid=124934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 15:51:21.800051 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.virt.hardware [None req-bcb1abe7-3e36-45dd-aa8c-3b9bb242b50c tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Image pref 0:0:0 {{(pid=124934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 15:51:21.800474 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.virt.hardware [None req-bcb1abe7-3e36-45dd-aa8c-3b9bb242b50c tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 15:51:21.809537 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-bcb1abe7-3e36-45dd-aa8c-3b9bb242b50c tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:21.810892 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-bcb1abe7-3e36-45dd-aa8c-3b9bb242b50c tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:21.811765 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-bcb1abe7-3e36-45dd-aa8c-3b9bb242b50c tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:21.816248 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-bcb1abe7-3e36-45dd-aa8c-3b9bb242b50c tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:21.830326 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.quota [None req-bcb1abe7-3e36-45dd-aa8c-3b9bb242b50c tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Getting quotas for project 58c0e4fa5fa246f08bb61703a42e2c59. Resources: {'ram', 'instances', 'cores'} {{(pid=124934) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 15:51:21.834447 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.quota [None req-bcb1abe7-3e36-45dd-aa8c-3b9bb242b50c tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Getting quotas for user 6c14e93cced14b1b95e2de8fedce31e8 and project 58c0e4fa5fa246f08bb61703a42e2c59. Resources: {'ram', 'instances', 'cores'} {{(pid=124934) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 15:51:21.846553 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-bcb1abe7-3e36-45dd-aa8c-3b9bb242b50c tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Going to run 1 instances... {{(pid=124934) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 15:51:21.848703 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-bcb1abe7-3e36-45dd-aa8c-3b9bb242b50c tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] [instance: 3c90392f-2134-4f71-aa44-680f7e6f5931] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5c8503f-3733-426f-8a5b-c7c9358e4a45',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124934) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 15:51:21.880022 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-7fc09491-291d-4b38-8afb-79e981657a33 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:21.887948 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-7fc09491-291d-4b38-8afb-79e981657a33 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:21.889469 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-7fc09491-291d-4b38-8afb-79e981657a33 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:21.890622 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-7fc09491-291d-4b38-8afb-79e981657a33 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305" status: 200 len: 1720 microversion: 2.20 time: 0.400190 May 23 15:51:21.891173 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 472/979] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:51:21 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 => generated 1720 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 15:51:21.896374 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-17ce3853-17a3-4935-88ea-028f0967b7dd tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:21.896978 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-17ce3853-17a3-4935-88ea-028f0967b7dd tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] [instance: 9c9f81be-b2c5-43c5-9640-3055f570b6b4] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:21.902568 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-17ce3853-17a3-4935-88ea-028f0967b7dd tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:21.903017 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-17ce3853-17a3-4935-88ea-028f0967b7dd tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:21.903798 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-17ce3853-17a3-4935-88ea-028f0967b7dd tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:21.904259 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-17ce3853-17a3-4935-88ea-028f0967b7dd tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:22.028228 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-bcb1abe7-3e36-45dd-aa8c-3b9bb242b50c tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.877258 May 23 15:51:22.029142 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 508/980] 10.222.0.64 () {60 vars in 1146 bytes} [Mon May 23 15:51:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 879 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 15:51:22.037686 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-17ce3853-17a3-4935-88ea-028f0967b7dd tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb19028337347329f21f278df8e98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1b36ef4dfe4aab851fe6c0d2680fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:22.038809 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-e7d0ec93-2cac-438d-b05d-c88ccdaf74e3 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:22.039427 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-e7d0ec93-2cac-438d-b05d-c88ccdaf74e3 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] [instance: 3c90392f-2134-4f71-aa44-680f7e6f5931] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:22.045632 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-17ce3853-17a3-4935-88ea-028f0967b7dd tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] 10.222.0.64 "GET /compute/v2.1/servers/9c9f81be-b2c5-43c5-9640-3055f570b6b4" status: 200 len: 1314 microversion: 2.1 time: 0.152951 May 23 15:51:22.046406 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 473/981] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:51:21 2022] GET /compute/v2.1/servers/9c9f81be-b2c5-43c5-9640-3055f570b6b4 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:51:22.094670 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-e7d0ec93-2cac-438d-b05d-c88ccdaf74e3 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c14e93cced14b1b95e2de8fedce31e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c0e4fa5fa246f08bb61703a42e2c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:22.102511 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-e7d0ec93-2cac-438d-b05d-c88ccdaf74e3 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] 10.222.0.64 "GET /compute/v2.1/servers/3c90392f-2134-4f71-aa44-680f7e6f5931" status: 200 len: 1219 microversion: 2.1 time: 0.067563 May 23 15:51:22.103076 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 509/982] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:51:22 2022] GET /compute/v2.1/servers/3c90392f-2134-4f71-aa44-680f7e6f5931 => generated 1219 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:51:22.910769 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-da1f8056-8dfa-4ced-9a2a-26b954a43df0 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:22.911377 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-da1f8056-8dfa-4ced-9a2a-26b954a43df0 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:22.913339 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_cell0:SELECT=2 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:51:22.918889 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-da1f8056-8dfa-4ced-9a2a-26b954a43df0 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:22.919350 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-da1f8056-8dfa-4ced-9a2a-26b954a43df0 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:22.920119 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-da1f8056-8dfa-4ced-9a2a-26b954a43df0 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:22.920564 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-da1f8056-8dfa-4ced-9a2a-26b954a43df0 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:23.053553 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-da1f8056-8dfa-4ced-9a2a-26b954a43df0 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:23.055729 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:51:23.062375 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-da1f8056-8dfa-4ced-9a2a-26b954a43df0 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:23.062958 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-7a800c2b-dda5-48c1-9881-4ed7d0e5c501 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:23.063821 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-7a800c2b-dda5-48c1-9881-4ed7d0e5c501 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] [instance: 9c9f81be-b2c5-43c5-9640-3055f570b6b4] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:23.064094 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-da1f8056-8dfa-4ced-9a2a-26b954a43df0 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:23.065322 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-da1f8056-8dfa-4ced-9a2a-26b954a43df0 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305" status: 200 len: 1720 microversion: 2.20 time: 0.159637 May 23 15:51:23.065886 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 474/983] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:51:22 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:51:23.071038 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-7a800c2b-dda5-48c1-9881-4ed7d0e5c501 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:23.071505 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-7a800c2b-dda5-48c1-9881-4ed7d0e5c501 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:23.072288 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-7a800c2b-dda5-48c1-9881-4ed7d0e5c501 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:23.072736 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-7a800c2b-dda5-48c1-9881-4ed7d0e5c501 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:23.076847 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_cell1:SELECT=79,nova_cell1:INSERT=1 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:51:23.119414 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-1de8e19a-812c-4f0a-8c0d-1016ffc23ef8 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:23.120024 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-1de8e19a-812c-4f0a-8c0d-1016ffc23ef8 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] [instance: 3c90392f-2134-4f71-aa44-680f7e6f5931] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:23.128236 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1de8e19a-812c-4f0a-8c0d-1016ffc23ef8 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:23.128694 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1de8e19a-812c-4f0a-8c0d-1016ffc23ef8 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:23.129507 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1de8e19a-812c-4f0a-8c0d-1016ffc23ef8 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:23.129958 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1de8e19a-812c-4f0a-8c0d-1016ffc23ef8 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:23.207340 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-1de8e19a-812c-4f0a-8c0d-1016ffc23ef8 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c14e93cced14b1b95e2de8fedce31e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c0e4fa5fa246f08bb61703a42e2c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:23.214610 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-1de8e19a-812c-4f0a-8c0d-1016ffc23ef8 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] 10.222.0.64 "GET /compute/v2.1/servers/3c90392f-2134-4f71-aa44-680f7e6f5931" status: 200 len: 1223 microversion: 2.1 time: 0.099081 May 23 15:51:23.215206 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 475/984] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:51:23 2022] GET /compute/v2.1/servers/3c90392f-2134-4f71-aa44-680f7e6f5931 => generated 1223 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:51:23.228702 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-7a800c2b-dda5-48c1-9881-4ed7d0e5c501 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb19028337347329f21f278df8e98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1b36ef4dfe4aab851fe6c0d2680fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:23.236363 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-7a800c2b-dda5-48c1-9881-4ed7d0e5c501 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] 10.222.0.64 "GET /compute/v2.1/servers/9c9f81be-b2c5-43c5-9640-3055f570b6b4" status: 200 len: 1314 microversion: 2.1 time: 0.177453 May 23 15:51:23.236920 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 510/985] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:51:23 2022] GET /compute/v2.1/servers/9c9f81be-b2c5-43c5-9640-3055f570b6b4 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:51:24.083189 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-9aa08008-a52b-4e3b-9d9d-8da8837acffd tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:24.083920 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-9aa08008-a52b-4e3b-9d9d-8da8837acffd tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:24.086548 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:51:24.092329 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-9aa08008-a52b-4e3b-9d9d-8da8837acffd tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:24.092793 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-9aa08008-a52b-4e3b-9d9d-8da8837acffd tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:24.093615 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-9aa08008-a52b-4e3b-9d9d-8da8837acffd tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:24.094059 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-9aa08008-a52b-4e3b-9d9d-8da8837acffd tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:24.233514 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-6923d29e-7238-4f85-9a56-c11aaa73cda7 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:24.234724 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-6923d29e-7238-4f85-9a56-c11aaa73cda7 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] [instance: 3c90392f-2134-4f71-aa44-680f7e6f5931] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:24.242992 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-6923d29e-7238-4f85-9a56-c11aaa73cda7 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:24.243449 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-6923d29e-7238-4f85-9a56-c11aaa73cda7 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:24.244230 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-6923d29e-7238-4f85-9a56-c11aaa73cda7 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:24.244674 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-6923d29e-7238-4f85-9a56-c11aaa73cda7 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:24.331382 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-6923d29e-7238-4f85-9a56-c11aaa73cda7 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c14e93cced14b1b95e2de8fedce31e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c0e4fa5fa246f08bb61703a42e2c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:24.340148 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-6923d29e-7238-4f85-9a56-c11aaa73cda7 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] 10.222.0.64 "GET /compute/v2.1/servers/3c90392f-2134-4f71-aa44-680f7e6f5931" status: 200 len: 1279 microversion: 2.1 time: 0.111527 May 23 15:51:24.341187 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 511/986] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:51:24 2022] GET /compute/v2.1/servers/3c90392f-2134-4f71-aa44-680f7e6f5931 => generated 1279 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:51:24.343222 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-9aa08008-a52b-4e3b-9d9d-8da8837acffd tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:24.347124 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-a73515b0-260d-4397-9640-020ab886fe9f tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:24.348006 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-a73515b0-260d-4397-9640-020ab886fe9f tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] [instance: 9c9f81be-b2c5-43c5-9640-3055f570b6b4] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:24.352798 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-9aa08008-a52b-4e3b-9d9d-8da8837acffd tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:24.354697 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-9aa08008-a52b-4e3b-9d9d-8da8837acffd tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:24.356051 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-a73515b0-260d-4397-9640-020ab886fe9f tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:24.356439 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-9aa08008-a52b-4e3b-9d9d-8da8837acffd tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305" status: 200 len: 1720 microversion: 2.20 time: 0.277521 May 23 15:51:24.357250 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-a73515b0-260d-4397-9640-020ab886fe9f tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:24.358311 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-a73515b0-260d-4397-9640-020ab886fe9f tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:24.359191 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-a73515b0-260d-4397-9640-020ab886fe9f tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:24.362029 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 476/987] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:51:24 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 => generated 1720 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:51:24.546069 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-a73515b0-260d-4397-9640-020ab886fe9f tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb19028337347329f21f278df8e98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1b36ef4dfe4aab851fe6c0d2680fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:24.554498 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-a73515b0-260d-4397-9640-020ab886fe9f tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] 10.222.0.64 "GET /compute/v2.1/servers/9c9f81be-b2c5-43c5-9640-3055f570b6b4" status: 200 len: 1314 microversion: 2.1 time: 0.212119 May 23 15:51:24.555159 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 512/988] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:51:24 2022] GET /compute/v2.1/servers/9c9f81be-b2c5-43c5-9640-3055f570b6b4 => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:51:25.358256 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-03b5b535-35f8-49ea-bed7-3bde14f732d3 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:25.359079 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-03b5b535-35f8-49ea-bed7-3bde14f732d3 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] [instance: 3c90392f-2134-4f71-aa44-680f7e6f5931] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:25.366711 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-03b5b535-35f8-49ea-bed7-3bde14f732d3 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:25.367161 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-03b5b535-35f8-49ea-bed7-3bde14f732d3 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:25.367920 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-03b5b535-35f8-49ea-bed7-3bde14f732d3 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:25.368351 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-03b5b535-35f8-49ea-bed7-3bde14f732d3 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:25.375577 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-984a987d-403b-481c-81d0-2f3fdb299167 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:25.377016 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-984a987d-403b-481c-81d0-2f3fdb299167 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:25.383789 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-984a987d-403b-481c-81d0-2f3fdb299167 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:25.384467 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-984a987d-403b-481c-81d0-2f3fdb299167 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:25.385292 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-984a987d-403b-481c-81d0-2f3fdb299167 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:25.385745 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-984a987d-403b-481c-81d0-2f3fdb299167 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:25.664278 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-03b5b535-35f8-49ea-bed7-3bde14f732d3 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c14e93cced14b1b95e2de8fedce31e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c0e4fa5fa246f08bb61703a42e2c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:25.671950 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-03b5b535-35f8-49ea-bed7-3bde14f732d3 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] 10.222.0.64 "GET /compute/v2.1/servers/3c90392f-2134-4f71-aa44-680f7e6f5931" status: 200 len: 1319 microversion: 2.1 time: 0.317497 May 23 15:51:25.680136 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 477/989] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:51:25 2022] GET /compute/v2.1/servers/3c90392f-2134-4f71-aa44-680f7e6f5931 => generated 1319 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:51:25.680136 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-ee3fb5d6-72df-4523-93da-2146327e2baf tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:25.680136 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-ee3fb5d6-72df-4523-93da-2146327e2baf tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] [instance: 9c9f81be-b2c5-43c5-9640-3055f570b6b4] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:25.682900 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-984a987d-403b-481c-81d0-2f3fdb299167 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:25.687084 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ee3fb5d6-72df-4523-93da-2146327e2baf tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:25.687544 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ee3fb5d6-72df-4523-93da-2146327e2baf tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:25.689212 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ee3fb5d6-72df-4523-93da-2146327e2baf tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:25.689725 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ee3fb5d6-72df-4523-93da-2146327e2baf tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:25.705417 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-984a987d-403b-481c-81d0-2f3fdb299167 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:25.705417 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-984a987d-403b-481c-81d0-2f3fdb299167 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:25.705417 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-984a987d-403b-481c-81d0-2f3fdb299167 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305" status: 200 len: 1720 microversion: 2.20 time: 0.325109 May 23 15:51:25.706330 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 513/990] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:51:25 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 => generated 1720 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 15:51:25.850376 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-ee3fb5d6-72df-4523-93da-2146327e2baf tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb19028337347329f21f278df8e98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1b36ef4dfe4aab851fe6c0d2680fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:25.857743 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-ee3fb5d6-72df-4523-93da-2146327e2baf tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] 10.222.0.64 "GET /compute/v2.1/servers/9c9f81be-b2c5-43c5-9640-3055f570b6b4" status: 200 len: 1314 microversion: 2.1 time: 0.183020 May 23 15:51:25.858298 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 478/991] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:51:25 2022] GET /compute/v2.1/servers/9c9f81be-b2c5-43c5-9640-3055f570b6b4 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:51:26.277784 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [req-0e73ed02-31c5-4edc-bcfa-6e8b7aef8e9b req-6bc2d668-debc-43b4-8659-2e2fba9cf418 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c90392f-2134-4f71-aa44-680f7e6f5931", "tag": "f3c0ddf4-94c0-4874-9cd7-6fdd49dfe1f5"}]} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:51:26.287945 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [req-e27cc81e-21fc-4be0-a417-4562d33c218f req-40465d3e-6184-4ae5-aa70-d6b3438b7676 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c9f81be-b2c5-43c5-9640-3055f570b6b4", "name": "network-vif-plugged", "status": "completed", "tag": "a39c2919-e340-4c48-81ee-27fdb345a133"}]} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:51:26.298794 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-0e73ed02-31c5-4edc-bcfa-6e8b7aef8e9b req-6bc2d668-debc-43b4-8659-2e2fba9cf418 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:26.299253 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-0e73ed02-31c5-4edc-bcfa-6e8b7aef8e9b req-6bc2d668-debc-43b4-8659-2e2fba9cf418 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:26.311384 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-e27cc81e-21fc-4be0-a417-4562d33c218f req-40465d3e-6184-4ae5-aa70-d6b3438b7676 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:26.311384 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-e27cc81e-21fc-4be0-a417-4562d33c218f req-40465d3e-6184-4ae5-aa70-d6b3438b7676 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:26.311671 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.compute.server_external_events [req-0e73ed02-31c5-4edc-bcfa-6e8b7aef8e9b req-6bc2d668-debc-43b4-8659-2e2fba9cf418 service nova] Creating event network-changed:f3c0ddf4-94c0-4874-9cd7-6fdd49dfe1f5 for instance 3c90392f-2134-4f71-aa44-680f7e6f5931 on hv-cinder-84067 May 23 15:51:26.316354 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [req-0e73ed02-31c5-4edc-bcfa-6e8b7aef8e9b req-6bc2d668-debc-43b4-8659-2e2fba9cf418 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043071 May 23 15:51:26.317355 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 514/992] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:51:26.319234 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.compute.server_external_events [req-e27cc81e-21fc-4be0-a417-4562d33c218f req-40465d3e-6184-4ae5-aa70-d6b3438b7676 service nova] Creating event network-vif-plugged:a39c2919-e340-4c48-81ee-27fdb345a133 for instance 9c9f81be-b2c5-43c5-9640-3055f570b6b4 on hv-cinder-84067 May 23 15:51:26.323837 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [req-e27cc81e-21fc-4be0-a417-4562d33c218f req-40465d3e-6184-4ae5-aa70-d6b3438b7676 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039670 May 23 15:51:26.324423 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 479/993] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:51:26.691411 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-caced44f-e1fa-46bb-8374-dffb35a64f17 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:26.692238 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-caced44f-e1fa-46bb-8374-dffb35a64f17 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] [instance: 3c90392f-2134-4f71-aa44-680f7e6f5931] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:26.699244 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-caced44f-e1fa-46bb-8374-dffb35a64f17 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:26.700168 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-caced44f-e1fa-46bb-8374-dffb35a64f17 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:26.701160 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-caced44f-e1fa-46bb-8374-dffb35a64f17 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:26.701771 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-caced44f-e1fa-46bb-8374-dffb35a64f17 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:26.717686 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-f2f59139-4b04-4495-bb3c-57126be33af0 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:26.718974 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-f2f59139-4b04-4495-bb3c-57126be33af0 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:26.726671 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-f2f59139-4b04-4495-bb3c-57126be33af0 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:26.731455 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-f2f59139-4b04-4495-bb3c-57126be33af0 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:26.731455 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-f2f59139-4b04-4495-bb3c-57126be33af0 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:26.731455 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-f2f59139-4b04-4495-bb3c-57126be33af0 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:26.944530 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-caced44f-e1fa-46bb-8374-dffb35a64f17 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c14e93cced14b1b95e2de8fedce31e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c0e4fa5fa246f08bb61703a42e2c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:26.950156 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-f2f59139-4b04-4495-bb3c-57126be33af0 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:26.953203 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-caced44f-e1fa-46bb-8374-dffb35a64f17 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] 10.222.0.64 "GET /compute/v2.1/servers/3c90392f-2134-4f71-aa44-680f7e6f5931" status: 200 len: 1319 microversion: 2.1 time: 0.266701 May 23 15:51:26.954785 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 515/994] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:51:26 2022] GET /compute/v2.1/servers/3c90392f-2134-4f71-aa44-680f7e6f5931 => generated 1319 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:51:26.958459 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-f2f59139-4b04-4495-bb3c-57126be33af0 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:26.959372 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-16e1aa8d-11a6-4654-b27a-ac7b245048c8 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:26.959984 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-16e1aa8d-11a6-4654-b27a-ac7b245048c8 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] [instance: 9c9f81be-b2c5-43c5-9640-3055f570b6b4] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:26.960115 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-f2f59139-4b04-4495-bb3c-57126be33af0 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:26.961324 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-f2f59139-4b04-4495-bb3c-57126be33af0 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305" status: 200 len: 1720 microversion: 2.20 time: 0.249345 May 23 15:51:26.962096 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 480/995] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:51:26 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 => generated 1720 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 15:51:26.966403 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-16e1aa8d-11a6-4654-b27a-ac7b245048c8 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:26.966856 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-16e1aa8d-11a6-4654-b27a-ac7b245048c8 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:26.967625 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-16e1aa8d-11a6-4654-b27a-ac7b245048c8 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:26.968066 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-16e1aa8d-11a6-4654-b27a-ac7b245048c8 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:27.126800 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-16e1aa8d-11a6-4654-b27a-ac7b245048c8 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb19028337347329f21f278df8e98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1b36ef4dfe4aab851fe6c0d2680fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:27.134118 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-16e1aa8d-11a6-4654-b27a-ac7b245048c8 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] 10.222.0.64 "GET /compute/v2.1/servers/9c9f81be-b2c5-43c5-9640-3055f570b6b4" status: 200 len: 1314 microversion: 2.1 time: 0.178392 May 23 15:51:27.134679 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 516/996] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:51:26 2022] GET /compute/v2.1/servers/9c9f81be-b2c5-43c5-9640-3055f570b6b4 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:51:27.971069 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-044b4fec-f2c9-4673-a7f7-5d112426a691 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:27.971766 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-044b4fec-f2c9-4673-a7f7-5d112426a691 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] [instance: 3c90392f-2134-4f71-aa44-680f7e6f5931] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:27.978415 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-044b4fec-f2c9-4673-a7f7-5d112426a691 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:27.978872 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-044b4fec-f2c9-4673-a7f7-5d112426a691 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:27.979199 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-678cf36b-e1ea-49de-81e1-6370bea8d321 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:27.979670 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-044b4fec-f2c9-4673-a7f7-5d112426a691 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:27.979818 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-678cf36b-e1ea-49de-81e1-6370bea8d321 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:27.980111 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-044b4fec-f2c9-4673-a7f7-5d112426a691 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:27.987657 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-678cf36b-e1ea-49de-81e1-6370bea8d321 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:27.988115 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-678cf36b-e1ea-49de-81e1-6370bea8d321 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:27.988890 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-678cf36b-e1ea-49de-81e1-6370bea8d321 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:27.989360 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-678cf36b-e1ea-49de-81e1-6370bea8d321 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:28.171065 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-044b4fec-f2c9-4673-a7f7-5d112426a691 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c14e93cced14b1b95e2de8fedce31e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c0e4fa5fa246f08bb61703a42e2c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:28.179670 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-044b4fec-f2c9-4673-a7f7-5d112426a691 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] 10.222.0.64 "GET /compute/v2.1/servers/3c90392f-2134-4f71-aa44-680f7e6f5931" status: 200 len: 1319 microversion: 2.1 time: 0.212609 May 23 15:51:28.180242 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 481/997] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:51:27 2022] GET /compute/v2.1/servers/3c90392f-2134-4f71-aa44-680f7e6f5931 => generated 1319 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:51:28.183368 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-678cf36b-e1ea-49de-81e1-6370bea8d321 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:28.184705 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-c7579b8f-e20e-4c71-8af6-c59bfffc6824 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:28.185502 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-c7579b8f-e20e-4c71-8af6-c59bfffc6824 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] [instance: 9c9f81be-b2c5-43c5-9640-3055f570b6b4] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:28.191199 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c7579b8f-e20e-4c71-8af6-c59bfffc6824 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:28.191655 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c7579b8f-e20e-4c71-8af6-c59bfffc6824 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:28.192436 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c7579b8f-e20e-4c71-8af6-c59bfffc6824 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:28.192632 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-678cf36b-e1ea-49de-81e1-6370bea8d321 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:28.192943 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c7579b8f-e20e-4c71-8af6-c59bfffc6824 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:28.194370 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-678cf36b-e1ea-49de-81e1-6370bea8d321 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:28.195859 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-678cf36b-e1ea-49de-81e1-6370bea8d321 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305" status: 200 len: 1720 microversion: 2.20 time: 0.220541 May 23 15:51:28.196693 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 517/998] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:51:27 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 => generated 1720 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 15:51:28.325492 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-c7579b8f-e20e-4c71-8af6-c59bfffc6824 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb19028337347329f21f278df8e98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1b36ef4dfe4aab851fe6c0d2680fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:28.333186 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-c7579b8f-e20e-4c71-8af6-c59bfffc6824 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] 10.222.0.64 "GET /compute/v2.1/servers/9c9f81be-b2c5-43c5-9640-3055f570b6b4" status: 200 len: 1314 microversion: 2.1 time: 0.151966 May 23 15:51:28.336841 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 482/999] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:51:28 2022] GET /compute/v2.1/servers/9c9f81be-b2c5-43c5-9640-3055f570b6b4 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:51:29.195721 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-cc2d3445-6891-43f4-8477-3f3292e1893a tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:29.196340 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-cc2d3445-6891-43f4-8477-3f3292e1893a tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] [instance: 3c90392f-2134-4f71-aa44-680f7e6f5931] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:29.202889 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-cc2d3445-6891-43f4-8477-3f3292e1893a tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:29.203381 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-cc2d3445-6891-43f4-8477-3f3292e1893a tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:29.204158 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-cc2d3445-6891-43f4-8477-3f3292e1893a tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:29.204606 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-cc2d3445-6891-43f4-8477-3f3292e1893a tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:29.214502 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-5c984836-2be8-4b6d-944f-d91d5d86995c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:29.215738 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-5c984836-2be8-4b6d-944f-d91d5d86995c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:29.223634 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-5c984836-2be8-4b6d-944f-d91d5d86995c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:29.224098 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-5c984836-2be8-4b6d-944f-d91d5d86995c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:29.224884 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-5c984836-2be8-4b6d-944f-d91d5d86995c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:29.225413 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-5c984836-2be8-4b6d-944f-d91d5d86995c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:29.406332 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-cc2d3445-6891-43f4-8477-3f3292e1893a tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c14e93cced14b1b95e2de8fedce31e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c0e4fa5fa246f08bb61703a42e2c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:29.413430 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-5c984836-2be8-4b6d-944f-d91d5d86995c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:29.414366 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-cc2d3445-6891-43f4-8477-3f3292e1893a tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] 10.222.0.64 "GET /compute/v2.1/servers/3c90392f-2134-4f71-aa44-680f7e6f5931" status: 200 len: 1319 microversion: 2.1 time: 0.222568 May 23 15:51:29.414943 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 518/1000] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:51:29 2022] GET /compute/v2.1/servers/3c90392f-2134-4f71-aa44-680f7e6f5931 => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:51:29.419567 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-aaa456a4-a48f-46ae-b574-e55735d48ed6 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:29.420185 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-aaa456a4-a48f-46ae-b574-e55735d48ed6 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] [instance: 9c9f81be-b2c5-43c5-9640-3055f570b6b4] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:29.421724 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-5c984836-2be8-4b6d-944f-d91d5d86995c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:29.424133 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-5c984836-2be8-4b6d-944f-d91d5d86995c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:29.425588 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-5c984836-2be8-4b6d-944f-d91d5d86995c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305" status: 200 len: 1720 microversion: 2.20 time: 0.214998 May 23 15:51:29.426134 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 483/1001] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:51:29 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 => generated 1720 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 15:51:29.428101 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-aaa456a4-a48f-46ae-b574-e55735d48ed6 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:29.428552 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-aaa456a4-a48f-46ae-b574-e55735d48ed6 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:29.429417 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-aaa456a4-a48f-46ae-b574-e55735d48ed6 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:29.429854 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-aaa456a4-a48f-46ae-b574-e55735d48ed6 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:29.561069 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-aaa456a4-a48f-46ae-b574-e55735d48ed6 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb19028337347329f21f278df8e98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1b36ef4dfe4aab851fe6c0d2680fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:29.568806 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-aaa456a4-a48f-46ae-b574-e55735d48ed6 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] 10.222.0.64 "GET /compute/v2.1/servers/9c9f81be-b2c5-43c5-9640-3055f570b6b4" status: 200 len: 1464 microversion: 2.1 time: 0.152887 May 23 15:51:29.569428 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 519/1002] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:51:29 2022] GET /compute/v2.1/servers/9c9f81be-b2c5-43c5-9640-3055f570b6b4 => generated 1464 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:51:29.609117 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-998e50cb-dc83-49a8-8956-67af9d59ebfd tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:29.609618 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-998e50cb-dc83-49a8-8956-67af9d59ebfd tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] [instance: 9c9f81be-b2c5-43c5-9640-3055f570b6b4] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:29.616452 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-998e50cb-dc83-49a8-8956-67af9d59ebfd tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:29.616895 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-998e50cb-dc83-49a8-8956-67af9d59ebfd tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:29.617700 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-998e50cb-dc83-49a8-8956-67af9d59ebfd tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:29.618133 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-998e50cb-dc83-49a8-8956-67af9d59ebfd tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:29.642208 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-998e50cb-dc83-49a8-8956-67af9d59ebfd tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] [instance: 9c9f81be-b2c5-43c5-9640-3055f570b6b4] Going to try to terminate instance {{(pid=124933) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 15:51:29.911578 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-998e50cb-dc83-49a8-8956-67af9d59ebfd tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] 10.222.0.64 "DELETE /compute/v2.1/servers/9c9f81be-b2c5-43c5-9640-3055f570b6b4" status: 204 len: 0 microversion: 2.1 time: 0.306123 May 23 15:51:29.912168 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 484/1003] 10.222.0.64 () {58 vars in 1238 bytes} [Mon May 23 15:51:29 2022] DELETE /compute/v2.1/servers/9c9f81be-b2c5-43c5-9640-3055f570b6b4 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 15:51:29.920349 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-35e357d9-d185-4afc-b27f-dd038fd6b916 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:29.920963 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-35e357d9-d185-4afc-b27f-dd038fd6b916 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] [instance: 9c9f81be-b2c5-43c5-9640-3055f570b6b4] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:29.927344 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-35e357d9-d185-4afc-b27f-dd038fd6b916 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:29.927806 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-35e357d9-d185-4afc-b27f-dd038fd6b916 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:29.928580 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-35e357d9-d185-4afc-b27f-dd038fd6b916 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:29.929028 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-35e357d9-d185-4afc-b27f-dd038fd6b916 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:30.055167 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-35e357d9-d185-4afc-b27f-dd038fd6b916 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb19028337347329f21f278df8e98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1b36ef4dfe4aab851fe6c0d2680fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:30.062786 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-35e357d9-d185-4afc-b27f-dd038fd6b916 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] 10.222.0.64 "GET /compute/v2.1/servers/9c9f81be-b2c5-43c5-9640-3055f570b6b4" status: 200 len: 1470 microversion: 2.1 time: 0.146255 May 23 15:51:30.063407 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 520/1004] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:51:29 2022] GET /compute/v2.1/servers/9c9f81be-b2c5-43c5-9640-3055f570b6b4 => generated 1470 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:51:30.432275 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-32bbb153-9907-4aaa-bf92-3c7bdd1e5b86 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:30.432994 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-32bbb153-9907-4aaa-bf92-3c7bdd1e5b86 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] [instance: 3c90392f-2134-4f71-aa44-680f7e6f5931] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:30.440025 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-32bbb153-9907-4aaa-bf92-3c7bdd1e5b86 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:30.440474 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-32bbb153-9907-4aaa-bf92-3c7bdd1e5b86 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:30.441391 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-32bbb153-9907-4aaa-bf92-3c7bdd1e5b86 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:30.441829 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-32bbb153-9907-4aaa-bf92-3c7bdd1e5b86 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:30.444482 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-9175fbe6-5d0d-4f6a-956d-d4e860a3b12e tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:30.446312 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-9175fbe6-5d0d-4f6a-956d-d4e860a3b12e tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:30.451648 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-9175fbe6-5d0d-4f6a-956d-d4e860a3b12e tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:30.452105 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-9175fbe6-5d0d-4f6a-956d-d4e860a3b12e tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:30.452882 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-9175fbe6-5d0d-4f6a-956d-d4e860a3b12e tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:30.453358 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-9175fbe6-5d0d-4f6a-956d-d4e860a3b12e tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:30.640307 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-32bbb153-9907-4aaa-bf92-3c7bdd1e5b86 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c14e93cced14b1b95e2de8fedce31e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c0e4fa5fa246f08bb61703a42e2c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:30.643522 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-9175fbe6-5d0d-4f6a-956d-d4e860a3b12e tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:30.648624 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-32bbb153-9907-4aaa-bf92-3c7bdd1e5b86 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] 10.222.0.64 "GET /compute/v2.1/servers/3c90392f-2134-4f71-aa44-680f7e6f5931" status: 200 len: 1319 microversion: 2.1 time: 0.220780 May 23 15:51:30.649214 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 485/1005] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:51:30 2022] GET /compute/v2.1/servers/3c90392f-2134-4f71-aa44-680f7e6f5931 => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:51:30.651505 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-9175fbe6-5d0d-4f6a-956d-d4e860a3b12e tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:30.653028 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-9175fbe6-5d0d-4f6a-956d-d4e860a3b12e tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:30.654252 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-9175fbe6-5d0d-4f6a-956d-d4e860a3b12e tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305" status: 200 len: 1720 microversion: 2.20 time: 0.213843 May 23 15:51:30.654805 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 521/1006] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:51:30 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 => generated 1720 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 15:51:31.080123 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-62f5d5ef-be76-4e26-9692-82355c36411b tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:31.080738 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-62f5d5ef-be76-4e26-9692-82355c36411b tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] [instance: 9c9f81be-b2c5-43c5-9640-3055f570b6b4] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:31.087003 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-62f5d5ef-be76-4e26-9692-82355c36411b tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:31.087451 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-62f5d5ef-be76-4e26-9692-82355c36411b tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:31.088215 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-62f5d5ef-be76-4e26-9692-82355c36411b tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:31.088654 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-62f5d5ef-be76-4e26-9692-82355c36411b tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:31.217279 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-62f5d5ef-be76-4e26-9692-82355c36411b tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb19028337347329f21f278df8e98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1b36ef4dfe4aab851fe6c0d2680fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:31.225756 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-62f5d5ef-be76-4e26-9692-82355c36411b tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] 10.222.0.64 "GET /compute/v2.1/servers/9c9f81be-b2c5-43c5-9640-3055f570b6b4" status: 200 len: 1470 microversion: 2.1 time: 0.150119 May 23 15:51:31.226321 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 486/1007] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:51:31 2022] GET /compute/v2.1/servers/9c9f81be-b2c5-43c5-9640-3055f570b6b4 => generated 1470 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:51:31.665723 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-66191027-480e-462e-b957-c2b61aafe371 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:31.666766 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-66191027-480e-462e-b957-c2b61aafe371 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] [instance: 3c90392f-2134-4f71-aa44-680f7e6f5931] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:31.671429 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-fa6ecc63-d468-403e-968e-fe95cd6f46af tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:31.672035 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-fa6ecc63-d468-403e-968e-fe95cd6f46af tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:31.673255 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-66191027-480e-462e-b957-c2b61aafe371 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:31.673809 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-66191027-480e-462e-b957-c2b61aafe371 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:31.674517 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-66191027-480e-462e-b957-c2b61aafe371 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:31.675240 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-66191027-480e-462e-b957-c2b61aafe371 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:31.678609 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-fa6ecc63-d468-403e-968e-fe95cd6f46af tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:31.679060 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-fa6ecc63-d468-403e-968e-fe95cd6f46af tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:31.679818 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-fa6ecc63-d468-403e-968e-fe95cd6f46af tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:31.680256 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-fa6ecc63-d468-403e-968e-fe95cd6f46af tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:31.820133 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_cell0:SELECT=4 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:51:31.972907 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-66191027-480e-462e-b957-c2b61aafe371 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c14e93cced14b1b95e2de8fedce31e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c0e4fa5fa246f08bb61703a42e2c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:31.980113 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-fa6ecc63-d468-403e-968e-fe95cd6f46af tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:31.980889 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-66191027-480e-462e-b957-c2b61aafe371 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] 10.222.0.64 "GET /compute/v2.1/servers/3c90392f-2134-4f71-aa44-680f7e6f5931" status: 200 len: 1319 microversion: 2.1 time: 0.318884 May 23 15:51:31.981510 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 522/1008] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:51:31 2022] GET /compute/v2.1/servers/3c90392f-2134-4f71-aa44-680f7e6f5931 => generated 1319 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:51:31.990137 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-fa6ecc63-d468-403e-968e-fe95cd6f46af tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:31.991772 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-fa6ecc63-d468-403e-968e-fe95cd6f46af tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:31.993209 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-fa6ecc63-d468-403e-968e-fe95cd6f46af tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305" status: 200 len: 1720 microversion: 2.20 time: 0.325482 May 23 15:51:31.993769 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 487/1009] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:51:31 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 => generated 1720 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 15:51:32.244361 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-d9b264de-5d7b-46b7-81ca-58dcd6cb53dd tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:32.245076 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-d9b264de-5d7b-46b7-81ca-58dcd6cb53dd tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] [instance: 9c9f81be-b2c5-43c5-9640-3055f570b6b4] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:32.247746 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_cell0:SELECT=14 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:51:32.253036 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-d9b264de-5d7b-46b7-81ca-58dcd6cb53dd tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:32.253519 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-d9b264de-5d7b-46b7-81ca-58dcd6cb53dd tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:32.254298 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-d9b264de-5d7b-46b7-81ca-58dcd6cb53dd tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:32.254767 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-d9b264de-5d7b-46b7-81ca-58dcd6cb53dd tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:32.350479 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [req-2997a2f2-b731-4b56-acdc-ddceb97bea2c req-bd288b96-1ff6-4acd-94b2-8d81971205bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c90392f-2134-4f71-aa44-680f7e6f5931", "name": "network-vif-plugged", "status": "completed", "tag": "f3c0ddf4-94c0-4874-9cd7-6fdd49dfe1f5"}]} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:51:32.358840 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-2997a2f2-b731-4b56-acdc-ddceb97bea2c req-bd288b96-1ff6-4acd-94b2-8d81971205bc service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:32.359293 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-2997a2f2-b731-4b56-acdc-ddceb97bea2c req-bd288b96-1ff6-4acd-94b2-8d81971205bc service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:32.377283 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.compute.server_external_events [req-2997a2f2-b731-4b56-acdc-ddceb97bea2c req-bd288b96-1ff6-4acd-94b2-8d81971205bc service nova] Creating event network-vif-plugged:f3c0ddf4-94c0-4874-9cd7-6fdd49dfe1f5 for instance 3c90392f-2134-4f71-aa44-680f7e6f5931 on hv-cinder-84067 May 23 15:51:32.382482 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [req-2997a2f2-b731-4b56-acdc-ddceb97bea2c req-bd288b96-1ff6-4acd-94b2-8d81971205bc service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035620 May 23 15:51:32.390743 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 488/1010] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:51:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:51:32.466381 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [req-d12bb887-93ee-40f9-8cf6-080f61f80653 req-acb2b065-f480-45f5-befe-2e48267c7037 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c9f81be-b2c5-43c5-9640-3055f570b6b4", "name": "network-vif-deleted", "tag": "a39c2919-e340-4c48-81ee-27fdb345a133"}]} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:51:32.482637 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-d12bb887-93ee-40f9-8cf6-080f61f80653 req-acb2b065-f480-45f5-befe-2e48267c7037 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:32.485515 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-d12bb887-93ee-40f9-8cf6-080f61f80653 req-acb2b065-f480-45f5-befe-2e48267c7037 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:32.502756 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.compute.server_external_events [req-d12bb887-93ee-40f9-8cf6-080f61f80653 req-acb2b065-f480-45f5-befe-2e48267c7037 service nova] Creating event network-vif-deleted:a39c2919-e340-4c48-81ee-27fdb345a133 for instance 9c9f81be-b2c5-43c5-9640-3055f570b6b4 on hv-cinder-84067 May 23 15:51:32.504678 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-d9b264de-5d7b-46b7-81ca-58dcd6cb53dd tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb19028337347329f21f278df8e98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1b36ef4dfe4aab851fe6c0d2680fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:32.509526 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [req-d12bb887-93ee-40f9-8cf6-080f61f80653 req-acb2b065-f480-45f5-befe-2e48267c7037 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050200 May 23 15:51:32.510434 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 489/1011] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:51:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:51:32.512658 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-d9b264de-5d7b-46b7-81ca-58dcd6cb53dd tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] 10.222.0.64 "GET /compute/v2.1/servers/9c9f81be-b2c5-43c5-9640-3055f570b6b4" status: 200 len: 1470 microversion: 2.1 time: 0.272595 May 23 15:51:32.513258 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 523/1012] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:51:32 2022] GET /compute/v2.1/servers/9c9f81be-b2c5-43c5-9640-3055f570b6b4 => generated 1470 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:51:32.998945 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-e59a79b8-00b7-48bf-a668-ca34216ac9b5 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:32.999640 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-e59a79b8-00b7-48bf-a668-ca34216ac9b5 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] [instance: 3c90392f-2134-4f71-aa44-680f7e6f5931] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:33.006534 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e59a79b8-00b7-48bf-a668-ca34216ac9b5 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:33.007022 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e59a79b8-00b7-48bf-a668-ca34216ac9b5 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:33.007753 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e59a79b8-00b7-48bf-a668-ca34216ac9b5 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:33.008188 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e59a79b8-00b7-48bf-a668-ca34216ac9b5 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:33.011817 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-42e648a2-5c9a-4adf-8df6-3923bb4d6a3d tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:33.012436 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-42e648a2-5c9a-4adf-8df6-3923bb4d6a3d tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:33.019442 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-42e648a2-5c9a-4adf-8df6-3923bb4d6a3d tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:33.019901 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-42e648a2-5c9a-4adf-8df6-3923bb4d6a3d tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:33.020689 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-42e648a2-5c9a-4adf-8df6-3923bb4d6a3d tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:33.021165 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-42e648a2-5c9a-4adf-8df6-3923bb4d6a3d tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:33.210011 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-e59a79b8-00b7-48bf-a668-ca34216ac9b5 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c14e93cced14b1b95e2de8fedce31e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c0e4fa5fa246f08bb61703a42e2c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:33.212707 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-42e648a2-5c9a-4adf-8df6-3923bb4d6a3d tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:33.217780 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-e59a79b8-00b7-48bf-a668-ca34216ac9b5 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] 10.222.0.64 "GET /compute/v2.1/servers/3c90392f-2134-4f71-aa44-680f7e6f5931" status: 200 len: 1319 microversion: 2.1 time: 0.223233 May 23 15:51:33.218465 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 490/1013] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:51:32 2022] GET /compute/v2.1/servers/3c90392f-2134-4f71-aa44-680f7e6f5931 => generated 1319 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:51:33.221831 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-42e648a2-5c9a-4adf-8df6-3923bb4d6a3d tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:33.223364 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-42e648a2-5c9a-4adf-8df6-3923bb4d6a3d tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:33.224783 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-42e648a2-5c9a-4adf-8df6-3923bb4d6a3d tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305" status: 200 len: 1741 microversion: 2.20 time: 0.216808 May 23 15:51:33.225297 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 524/1014] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:51:33 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 => generated 1741 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:51:33.530279 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-28900202-f96a-4d0a-9efe-27db257b18a3 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:33.530892 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-28900202-f96a-4d0a-9efe-27db257b18a3 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] [instance: 9c9f81be-b2c5-43c5-9640-3055f570b6b4] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:33.536861 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-28900202-f96a-4d0a-9efe-27db257b18a3 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:33.537319 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-28900202-f96a-4d0a-9efe-27db257b18a3 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:33.538073 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-28900202-f96a-4d0a-9efe-27db257b18a3 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:33.538506 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-28900202-f96a-4d0a-9efe-27db257b18a3 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:33.567942 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-28900202-f96a-4d0a-9efe-27db257b18a3 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:33.568389 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-28900202-f96a-4d0a-9efe-27db257b18a3 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:33.568834 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.objects.instance [None req-28900202-f96a-4d0a-9efe-27db257b18a3 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lazy-loading 'fault' on Instance uuid 9c9f81be-b2c5-43c5-9640-3055f570b6b4 {{(pid=124933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 15:51:33.571516 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:51:33.610629 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-28900202-f96a-4d0a-9efe-27db257b18a3 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb19028337347329f21f278df8e98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1b36ef4dfe4aab851fe6c0d2680fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:33.618081 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-28900202-f96a-4d0a-9efe-27db257b18a3 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] 10.222.0.64 "GET /compute/v2.1/servers/9c9f81be-b2c5-43c5-9640-3055f570b6b4" status: 200 len: 1304 microversion: 2.1 time: 0.091707 May 23 15:51:33.618668 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 491/1015] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:51:33 2022] GET /compute/v2.1/servers/9c9f81be-b2c5-43c5-9640-3055f570b6b4 => generated 1304 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:51:34.236405 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-515d66fe-e64c-4f01-b3b8-e58631c5240c tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:34.237027 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-515d66fe-e64c-4f01-b3b8-e58631c5240c tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] [instance: 3c90392f-2134-4f71-aa44-680f7e6f5931] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:34.239265 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=6 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:51:34.244543 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-515d66fe-e64c-4f01-b3b8-e58631c5240c tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:34.244967 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-515d66fe-e64c-4f01-b3b8-e58631c5240c tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:34.245784 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-515d66fe-e64c-4f01-b3b8-e58631c5240c tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:34.246241 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-515d66fe-e64c-4f01-b3b8-e58631c5240c tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:34.249980 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-ee591970-fbab-4d4e-b0f0-2d5db1141f34 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:34.252378 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-ee591970-fbab-4d4e-b0f0-2d5db1141f34 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:34.270693 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ee591970-fbab-4d4e-b0f0-2d5db1141f34 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:34.271260 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ee591970-fbab-4d4e-b0f0-2d5db1141f34 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:34.272059 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ee591970-fbab-4d4e-b0f0-2d5db1141f34 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:34.272719 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ee591970-fbab-4d4e-b0f0-2d5db1141f34 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:34.402185 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-515d66fe-e64c-4f01-b3b8-e58631c5240c tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c14e93cced14b1b95e2de8fedce31e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c0e4fa5fa246f08bb61703a42e2c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:34.415133 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-515d66fe-e64c-4f01-b3b8-e58631c5240c tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] 10.222.0.64 "GET /compute/v2.1/servers/3c90392f-2134-4f71-aa44-680f7e6f5931" status: 200 len: 1319 microversion: 2.1 time: 0.183233 May 23 15:51:34.416606 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 525/1016] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:51:34 2022] GET /compute/v2.1/servers/3c90392f-2134-4f71-aa44-680f7e6f5931 => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:51:34.630754 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-ee591970-fbab-4d4e-b0f0-2d5db1141f34 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:34.635827 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-43979e49-6494-4f31-9bbd-de0e2694dbf9 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:34.636493 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-43979e49-6494-4f31-9bbd-de0e2694dbf9 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] [instance: 9c9f81be-b2c5-43c5-9640-3055f570b6b4] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:34.643797 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-ee591970-fbab-4d4e-b0f0-2d5db1141f34 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:34.646436 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-43979e49-6494-4f31-9bbd-de0e2694dbf9 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:34.646436 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-43979e49-6494-4f31-9bbd-de0e2694dbf9 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:34.646436 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-43979e49-6494-4f31-9bbd-de0e2694dbf9 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:34.646436 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-43979e49-6494-4f31-9bbd-de0e2694dbf9 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:34.646789 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-ee591970-fbab-4d4e-b0f0-2d5db1141f34 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:34.647303 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-ee591970-fbab-4d4e-b0f0-2d5db1141f34 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305" status: 200 len: 1741 microversion: 2.20 time: 0.404761 May 23 15:51:34.648095 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 492/1017] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:51:34 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 => generated 1741 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 15:51:34.677432 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-43979e49-6494-4f31-9bbd-de0e2694dbf9 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:34.677811 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-43979e49-6494-4f31-9bbd-de0e2694dbf9 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:34.678267 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.objects.instance [None req-43979e49-6494-4f31-9bbd-de0e2694dbf9 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lazy-loading 'fault' on Instance uuid 9c9f81be-b2c5-43c5-9640-3055f570b6b4 {{(pid=124934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 15:51:34.718598 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-43979e49-6494-4f31-9bbd-de0e2694dbf9 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb19028337347329f21f278df8e98a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1b36ef4dfe4aab851fe6c0d2680fe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:34.727004 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-43979e49-6494-4f31-9bbd-de0e2694dbf9 tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] 10.222.0.64 "GET /compute/v2.1/servers/9c9f81be-b2c5-43c5-9640-3055f570b6b4" status: 200 len: 1304 microversion: 2.1 time: 0.095123 May 23 15:51:34.727587 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 526/1018] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:51:34 2022] GET /compute/v2.1/servers/9c9f81be-b2c5-43c5-9640-3055f570b6b4 => generated 1304 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:51:35.435725 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-7d63b03b-7aa4-4186-9f4c-96440cacbfbc tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:35.435725 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-7d63b03b-7aa4-4186-9f4c-96440cacbfbc tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] [instance: 3c90392f-2134-4f71-aa44-680f7e6f5931] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:35.442868 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-7d63b03b-7aa4-4186-9f4c-96440cacbfbc tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:35.443334 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-7d63b03b-7aa4-4186-9f4c-96440cacbfbc tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:35.444120 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-7d63b03b-7aa4-4186-9f4c-96440cacbfbc tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:35.444558 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-7d63b03b-7aa4-4186-9f4c-96440cacbfbc tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:35.666872 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-71ef3391-4e72-40c1-9748-75181b3b5bb7 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:35.667502 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-71ef3391-4e72-40c1-9748-75181b3b5bb7 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:35.672737 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-7d63b03b-7aa4-4186-9f4c-96440cacbfbc tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c14e93cced14b1b95e2de8fedce31e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c0e4fa5fa246f08bb61703a42e2c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:35.680284 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-71ef3391-4e72-40c1-9748-75181b3b5bb7 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:35.680747 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-71ef3391-4e72-40c1-9748-75181b3b5bb7 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:35.681607 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-71ef3391-4e72-40c1-9748-75181b3b5bb7 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:35.681969 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-7d63b03b-7aa4-4186-9f4c-96440cacbfbc tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] 10.222.0.64 "GET /compute/v2.1/servers/3c90392f-2134-4f71-aa44-680f7e6f5931" status: 200 len: 1508 microversion: 2.1 time: 0.252411 May 23 15:51:35.682103 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-71ef3391-4e72-40c1-9748-75181b3b5bb7 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:35.684886 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_cell1:SELECT=100 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:51:35.698777 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 493/1019] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:51:35 2022] GET /compute/v2.1/servers/3c90392f-2134-4f71-aa44-680f7e6f5931 => generated 1508 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:51:35.701229 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-d93603aa-8adb-4afb-8083-d32e403b0aa4 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "97bfc31a-355e-4c45-bc90-0d9a73388526", "device": "/dev/sdb"}} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:51:35.702534 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-d93603aa-8adb-4afb-8083-d32e403b0aa4 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] [instance: 3c90392f-2134-4f71-aa44-680f7e6f5931] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:35.718574 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-d93603aa-8adb-4afb-8083-d32e403b0aa4 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:35.719382 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-d93603aa-8adb-4afb-8083-d32e403b0aa4 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:35.720351 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-d93603aa-8adb-4afb-8083-d32e403b0aa4 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:35.720949 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-d93603aa-8adb-4afb-8083-d32e403b0aa4 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:35.939885 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-71ef3391-4e72-40c1-9748-75181b3b5bb7 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:35.948607 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-71ef3391-4e72-40c1-9748-75181b3b5bb7 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:35.950223 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-71ef3391-4e72-40c1-9748-75181b3b5bb7 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:35.951337 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-71ef3391-4e72-40c1-9748-75181b3b5bb7 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305" status: 200 len: 1736 microversion: 2.20 time: 0.288905 May 23 15:51:35.963564 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 527/1020] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:51:35 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 => generated 1736 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:51:35.963564 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-0f8fbe2f-ebb1-407d-b5ad-0fcfc98dd7bd tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:35.963564 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-0f8fbe2f-ebb1-407d-b5ad-0fcfc98dd7bd tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] [instance: 9c9f81be-b2c5-43c5-9640-3055f570b6b4] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:35.965557 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0f8fbe2f-ebb1-407d-b5ad-0fcfc98dd7bd tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:35.966034 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0f8fbe2f-ebb1-407d-b5ad-0fcfc98dd7bd tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:35.966829 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0f8fbe2f-ebb1-407d-b5ad-0fcfc98dd7bd tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:35.967283 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0f8fbe2f-ebb1-407d-b5ad-0fcfc98dd7bd tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:35.983500 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.wsgi [None req-0f8fbe2f-ebb1-407d-b5ad-0fcfc98dd7bd tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] HTTP exception thrown: Instance 9c9f81be-b2c5-43c5-9640-3055f570b6b4 could not be found. May 23 15:51:35.986046 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-0f8fbe2f-ebb1-407d-b5ad-0fcfc98dd7bd tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Request method failure captured: May 23 15:51:35.986046 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: request: GET /compute/v2.1/servers/9c9f81be-b2c5-43c5-9640-3055f570b6b4 HTTP/1.1 May 23 15:51:35.986046 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Accept: application/json May 23 15:51:35.986046 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Accept-Encoding: identity May 23 15:51:35.986046 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Connection: close May 23 15:51:35.986046 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Content-Length: 0 May 23 15:51:35.986046 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Content-Type: application/json May 23 15:51:35.986046 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Host: 10.222.0.64 May 23 15:51:35.986046 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Openstack-System-Scope: None May 23 15:51:35.986046 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: User-Agent: python-urllib3/1.26.9 May 23 15:51:35.986046 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Auth-Token: gAAAAABii61tIOQUT7AncvuVuinI85egoEeffjB8eN8LUDmpQuc4jLzGT2VvLZEVsjgBt-PwI6vRaZwi43ojs2WG_ReYJrJS6u-bA4PQXrtn0JhsdSinFJ4oXQyJ-_Gwc0-dg5mrvfMm0zEXA6mRraNrcTW4ONzSSWLz7ONNlPqOnSRTZMXDfBI May 23 15:51:35.986046 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Domain-Id: None May 23 15:51:35.986046 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Domain-Name: None May 23 15:51:35.986046 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Identity-Status: Confirmed May 23 15:51:35.986046 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Is-Admin-Project: True May 23 15:51:35.986046 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Domain-Id: default May 23 15:51:35.986046 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Domain-Name: Default May 23 15:51:35.986046 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Id: 4c1b36ef4dfe4aab851fe6c0d2680fe0 May 23 15:51:35.986046 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Name: tempest-VolumesNegativeTest-1591935800 May 23 15:51:35.986046 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Role: reader,member May 23 15:51:35.986046 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Roles: reader,member May 23 15:51:35.987732 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4c1b36ef4dfe4aab851fe6c0d2680fe0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/4c1b36ef4dfe4aab851fe6c0d2680fe0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4c1b36ef4dfe4aab851fe6c0d2680fe0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_4c1b36ef4dfe4aab851fe6c0d2680fe0", "adminURL": "http://10.222.0.64:8080"}]}] May 23 15:51:35.987732 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant: tempest-VolumesNegativeTest-1591935800 May 23 15:51:35.987732 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant-Id: 4c1b36ef4dfe4aab851fe6c0d2680fe0 May 23 15:51:35.987732 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant-Name: tempest-VolumesNegativeTest-1591935800 May 23 15:51:35.987732 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User: tempest-VolumesNegativeTest-1591935800-project May 23 15:51:35.987732 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Domain-Id: default May 23 15:51:35.987732 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Domain-Name: Default May 23 15:51:35.987732 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Id: 3cb19028337347329f21f278df8e98a7 May 23 15:51:35.987732 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Name: tempest-VolumesNegativeTest-1591935800-project May 23 15:51:35.987732 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: method: > May 23 15:51:35.987732 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: exception: Instance 9c9f81be-b2c5-43c5-9640-3055f570b6b4 could not be found. May 23 15:51:35.987732 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: action_args: {'id': '9c9f81be-b2c5-43c5-9640-3055f570b6b4'} May 23 15:51:35.988701 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:51:35.988701 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:51:35.988701 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:51:35.988701 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:51:35.988701 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:51:35.988701 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:51:35.988701 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:51:35.988701 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:51:35.988701 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:51:35.988701 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:51:35.988701 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c9f81be-b2c5-43c5-9640-3055f570b6b4 could not be found. May 23 15:51:35.988701 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:51:35.988701 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:51:35.988701 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:51:35.988701 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:51:35.988701 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:51:35.988701 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:51:35.988701 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:51:35.988701 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:51:35.988701 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:51:35.992379 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:51:35.992379 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 15:51:35.992379 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 15:51:35.992379 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:51:35.992379 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:51:35.992379 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:51:35.992379 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:51:35.992379 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c9f81be-b2c5-43c5-9640-3055f570b6b4 could not be found. May 23 15:51:35.992379 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:51:35.992379 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:51:35.992379 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:51:35.992379 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:51:35.992379 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:51:35.992379 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:51:35.992379 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:51:35.992379 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:51:35.992379 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c9f81be-b2c5-43c5-9640-3055f570b6b4 could not be found. May 23 15:51:35.992379 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:51:35.993648 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-0f8fbe2f-ebb1-407d-b5ad-0fcfc98dd7bd tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] Returning 404 to user: Instance 9c9f81be-b2c5-43c5-9640-3055f570b6b4 could not be found. {{(pid=124934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:51:35.993648 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-0f8fbe2f-ebb1-407d-b5ad-0fcfc98dd7bd tempest-VolumesNegativeTest-1591935800 tempest-VolumesNegativeTest-1591935800-project] 10.222.0.64 "GET /compute/v2.1/servers/9c9f81be-b2c5-43c5-9640-3055f570b6b4" status: 404 len: 111 microversion: 2.1 time: 0.033453 May 23 15:51:35.993648 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 528/1021] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:51:35 2022] GET /compute/v2.1/servers/9c9f81be-b2c5-43c5-9640-3055f570b6b4 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 15:51:36.331275 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [req-2fd76738-d320-41a7-b9f2-14dc9cb33010 req-81683e11-db28-4173-8329-fb1a0105b1db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e0a2baa-19d3-46f7-8585-c5272f971305", "name": "network-vif-plugged", "status": "completed", "tag": "afbaeb47-bccc-4c5c-8309-2469ca000cc2"}]} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:51:36.345868 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-2fd76738-d320-41a7-b9f2-14dc9cb33010 req-81683e11-db28-4173-8329-fb1a0105b1db service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:36.346906 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-2fd76738-d320-41a7-b9f2-14dc9cb33010 req-81683e11-db28-4173-8329-fb1a0105b1db service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:36.366535 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.compute.server_external_events [req-2fd76738-d320-41a7-b9f2-14dc9cb33010 req-81683e11-db28-4173-8329-fb1a0105b1db service nova] Creating event network-vif-plugged:afbaeb47-bccc-4c5c-8309-2469ca000cc2 for instance 6e0a2baa-19d3-46f7-8585-c5272f971305 on hv-cinder-84067 May 23 15:51:36.373316 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [req-2fd76738-d320-41a7-b9f2-14dc9cb33010 req-81683e11-db28-4173-8329-fb1a0105b1db service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046785 May 23 15:51:36.373316 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 529/1022] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:51:36.495577 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-d93603aa-8adb-4afb-8083-d32e403b0aa4 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] 10.222.0.64 "POST /compute/v2.1/servers/3c90392f-2134-4f71-aa44-680f7e6f5931/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.798918 May 23 15:51:36.498679 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 494/1023] 10.222.0.64 () {60 vars in 1322 bytes} [Mon May 23 15:51:35 2022] POST /compute/v2.1/servers/3c90392f-2134-4f71-aa44-680f7e6f5931/os-volume_attachments => generated 194 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:51:36.973039 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-e43bab71-6c62-4a9e-8ceb-088893e1bf9e tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:36.975709 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-e43bab71-6c62-4a9e-8ceb-088893e1bf9e tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:36.981569 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e43bab71-6c62-4a9e-8ceb-088893e1bf9e tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:36.982430 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e43bab71-6c62-4a9e-8ceb-088893e1bf9e tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:36.991853 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e43bab71-6c62-4a9e-8ceb-088893e1bf9e tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:36.992716 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e43bab71-6c62-4a9e-8ceb-088893e1bf9e tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:37.197137 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-e43bab71-6c62-4a9e-8ceb-088893e1bf9e tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:37.206161 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-e43bab71-6c62-4a9e-8ceb-088893e1bf9e tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:37.207441 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-e43bab71-6c62-4a9e-8ceb-088893e1bf9e tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:37.208650 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-e43bab71-6c62-4a9e-8ceb-088893e1bf9e tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305" status: 200 len: 1736 microversion: 2.20 time: 0.241226 May 23 15:51:37.209229 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 530/1024] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:51:36 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 => generated 1736 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:51:38.228997 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-3261cec2-9054-4267-82bc-a3e37e456694 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:38.229846 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-3261cec2-9054-4267-82bc-a3e37e456694 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:38.238999 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-3261cec2-9054-4267-82bc-a3e37e456694 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:38.239620 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-3261cec2-9054-4267-82bc-a3e37e456694 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:38.240500 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-3261cec2-9054-4267-82bc-a3e37e456694 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:38.241037 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-3261cec2-9054-4267-82bc-a3e37e456694 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:38.406417 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-3261cec2-9054-4267-82bc-a3e37e456694 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:38.416341 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-3261cec2-9054-4267-82bc-a3e37e456694 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:38.418056 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-3261cec2-9054-4267-82bc-a3e37e456694 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:38.419404 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-3261cec2-9054-4267-82bc-a3e37e456694 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305" status: 200 len: 1736 microversion: 2.20 time: 0.195617 May 23 15:51:38.419961 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 495/1025] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:51:38 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 => generated 1736 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:51:39.440765 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-034f1390-12c1-4d02-8fa2-129f56374e94 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:39.441400 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-034f1390-12c1-4d02-8fa2-129f56374e94 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:39.450265 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-034f1390-12c1-4d02-8fa2-129f56374e94 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:39.450795 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-034f1390-12c1-4d02-8fa2-129f56374e94 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:39.451676 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-034f1390-12c1-4d02-8fa2-129f56374e94 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:39.452251 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-034f1390-12c1-4d02-8fa2-129f56374e94 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:39.619036 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-034f1390-12c1-4d02-8fa2-129f56374e94 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:39.630228 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-034f1390-12c1-4d02-8fa2-129f56374e94 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:39.634043 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-034f1390-12c1-4d02-8fa2-129f56374e94 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:39.635470 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-034f1390-12c1-4d02-8fa2-129f56374e94 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305" status: 200 len: 1736 microversion: 2.20 time: 0.201589 May 23 15:51:39.636366 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 531/1026] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:51:39 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 => generated 1736 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:51:40.657384 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-7d520466-6427-4ec6-a078-49cf25ae7914 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:40.658799 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-7d520466-6427-4ec6-a078-49cf25ae7914 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:40.665795 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-7d520466-6427-4ec6-a078-49cf25ae7914 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:40.666874 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-7d520466-6427-4ec6-a078-49cf25ae7914 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:40.670206 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-7d520466-6427-4ec6-a078-49cf25ae7914 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:40.670731 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-7d520466-6427-4ec6-a078-49cf25ae7914 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:40.899665 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-7d520466-6427-4ec6-a078-49cf25ae7914 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:40.912568 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-7d520466-6427-4ec6-a078-49cf25ae7914 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:40.914126 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-7d520466-6427-4ec6-a078-49cf25ae7914 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:40.915519 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-7d520466-6427-4ec6-a078-49cf25ae7914 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305" status: 200 len: 1736 microversion: 2.20 time: 0.264718 May 23 15:51:40.916066 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 496/1027] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:51:40 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 => generated 1736 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:51:41.934630 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-dab6dc62-573c-4127-9c54-7f84f2e7c519 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:41.935246 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-dab6dc62-573c-4127-9c54-7f84f2e7c519 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:41.942797 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-dab6dc62-573c-4127-9c54-7f84f2e7c519 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:41.943254 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-dab6dc62-573c-4127-9c54-7f84f2e7c519 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:41.944017 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-dab6dc62-573c-4127-9c54-7f84f2e7c519 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:41.944464 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-dab6dc62-573c-4127-9c54-7f84f2e7c519 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:42.106413 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-dab6dc62-573c-4127-9c54-7f84f2e7c519 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:42.115882 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-dab6dc62-573c-4127-9c54-7f84f2e7c519 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:42.120958 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-dab6dc62-573c-4127-9c54-7f84f2e7c519 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:42.123583 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-dab6dc62-573c-4127-9c54-7f84f2e7c519 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305" status: 200 len: 1736 microversion: 2.20 time: 0.192897 May 23 15:51:42.124617 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 532/1028] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:51:41 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 => generated 1736 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:51:43.143450 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-e04526fb-262d-4dd3-b406-9c497711d05b tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:43.144065 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-e04526fb-262d-4dd3-b406-9c497711d05b tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:43.159722 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e04526fb-262d-4dd3-b406-9c497711d05b tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:43.160393 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e04526fb-262d-4dd3-b406-9c497711d05b tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:43.161366 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e04526fb-262d-4dd3-b406-9c497711d05b tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:43.161914 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e04526fb-262d-4dd3-b406-9c497711d05b tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:43.399700 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-e04526fb-262d-4dd3-b406-9c497711d05b tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:43.411896 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-e04526fb-262d-4dd3-b406-9c497711d05b tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:43.421230 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-e04526fb-262d-4dd3-b406-9c497711d05b tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:43.421230 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-e04526fb-262d-4dd3-b406-9c497711d05b tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305" status: 200 len: 1736 microversion: 2.20 time: 0.276533 May 23 15:51:43.421230 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 497/1029] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:51:43 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 => generated 1736 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:51:44.438024 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-ecd96d78-5321-4beb-9c67-a453a7f70582 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:44.439389 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-ecd96d78-5321-4beb-9c67-a453a7f70582 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:44.451557 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ecd96d78-5321-4beb-9c67-a453a7f70582 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:44.452111 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ecd96d78-5321-4beb-9c67-a453a7f70582 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:44.452963 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ecd96d78-5321-4beb-9c67-a453a7f70582 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:44.454085 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ecd96d78-5321-4beb-9c67-a453a7f70582 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:44.597543 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-ecd96d78-5321-4beb-9c67-a453a7f70582 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:44.606002 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-ecd96d78-5321-4beb-9c67-a453a7f70582 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:44.607516 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-ecd96d78-5321-4beb-9c67-a453a7f70582 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:44.608701 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-ecd96d78-5321-4beb-9c67-a453a7f70582 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305" status: 200 len: 1736 microversion: 2.20 time: 0.174602 May 23 15:51:44.609373 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 533/1030] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:51:44 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 => generated 1736 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:51:45.629555 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-a1a6a59a-6633-4203-a87e-83d29c9b5a2a tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:45.630916 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-a1a6a59a-6633-4203-a87e-83d29c9b5a2a tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:45.638316 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a1a6a59a-6633-4203-a87e-83d29c9b5a2a tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:45.639056 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a1a6a59a-6633-4203-a87e-83d29c9b5a2a tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:45.640109 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a1a6a59a-6633-4203-a87e-83d29c9b5a2a tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:45.641121 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a1a6a59a-6633-4203-a87e-83d29c9b5a2a tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:45.816917 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-a1a6a59a-6633-4203-a87e-83d29c9b5a2a tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:45.830925 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-a1a6a59a-6633-4203-a87e-83d29c9b5a2a tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:45.832811 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-a1a6a59a-6633-4203-a87e-83d29c9b5a2a tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:45.834224 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-a1a6a59a-6633-4203-a87e-83d29c9b5a2a tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305" status: 200 len: 1736 microversion: 2.20 time: 0.211052 May 23 15:51:45.837138 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 498/1031] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:51:45 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 => generated 1736 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:51:46.411920 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 15:51:46.412439 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Mon May 23 15:51:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 15:51:46.852058 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-65d90fd2-8e32-49c8-951b-5c9bb1bf5d81 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:46.852633 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-65d90fd2-8e32-49c8-951b-5c9bb1bf5d81 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:46.859356 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-65d90fd2-8e32-49c8-951b-5c9bb1bf5d81 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:46.860205 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-65d90fd2-8e32-49c8-951b-5c9bb1bf5d81 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:46.860987 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-65d90fd2-8e32-49c8-951b-5c9bb1bf5d81 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:46.861453 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-65d90fd2-8e32-49c8-951b-5c9bb1bf5d81 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:46.991213 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-65d90fd2-8e32-49c8-951b-5c9bb1bf5d81 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:46.999098 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-65d90fd2-8e32-49c8-951b-5c9bb1bf5d81 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:47.001189 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-65d90fd2-8e32-49c8-951b-5c9bb1bf5d81 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:47.002343 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-65d90fd2-8e32-49c8-951b-5c9bb1bf5d81 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305" status: 200 len: 1736 microversion: 2.20 time: 0.154606 May 23 15:51:47.002891 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 534/1032] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:51:46 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:51:48.020627 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-173a85ab-886d-43d5-83de-e49dcded6a11 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:48.021305 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-173a85ab-886d-43d5-83de-e49dcded6a11 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:48.027767 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-173a85ab-886d-43d5-83de-e49dcded6a11 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:48.028225 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-173a85ab-886d-43d5-83de-e49dcded6a11 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:48.028996 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-173a85ab-886d-43d5-83de-e49dcded6a11 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:48.029471 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-173a85ab-886d-43d5-83de-e49dcded6a11 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:48.158677 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-173a85ab-886d-43d5-83de-e49dcded6a11 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:48.166428 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-173a85ab-886d-43d5-83de-e49dcded6a11 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:48.167925 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-173a85ab-886d-43d5-83de-e49dcded6a11 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:48.169151 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-173a85ab-886d-43d5-83de-e49dcded6a11 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305" status: 200 len: 1736 microversion: 2.20 time: 0.152403 May 23 15:51:48.169648 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 499/1033] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:51:48 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:51:49.187552 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-5e7616be-ec76-4a07-ad3f-2f2addcc941f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:49.188293 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-5e7616be-ec76-4a07-ad3f-2f2addcc941f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:49.194984 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5e7616be-ec76-4a07-ad3f-2f2addcc941f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:49.195444 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5e7616be-ec76-4a07-ad3f-2f2addcc941f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:49.196222 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5e7616be-ec76-4a07-ad3f-2f2addcc941f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:49.196674 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5e7616be-ec76-4a07-ad3f-2f2addcc941f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:49.327721 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-5e7616be-ec76-4a07-ad3f-2f2addcc941f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:49.336187 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-5e7616be-ec76-4a07-ad3f-2f2addcc941f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:49.337718 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-5e7616be-ec76-4a07-ad3f-2f2addcc941f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:49.338874 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-5e7616be-ec76-4a07-ad3f-2f2addcc941f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305" status: 200 len: 1736 microversion: 2.20 time: 0.155268 May 23 15:51:49.339419 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 535/1034] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:51:49 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:51:50.358145 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-1d5a22fd-697c-45c2-8498-2d48a2c2648c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:50.358781 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-1d5a22fd-697c-45c2-8498-2d48a2c2648c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:50.366010 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1d5a22fd-697c-45c2-8498-2d48a2c2648c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:50.366521 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1d5a22fd-697c-45c2-8498-2d48a2c2648c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:50.367298 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1d5a22fd-697c-45c2-8498-2d48a2c2648c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:50.367737 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-1d5a22fd-697c-45c2-8498-2d48a2c2648c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:50.499530 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-1d5a22fd-697c-45c2-8498-2d48a2c2648c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:50.507458 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-1d5a22fd-697c-45c2-8498-2d48a2c2648c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:50.508953 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-1d5a22fd-697c-45c2-8498-2d48a2c2648c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:50.510144 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-1d5a22fd-697c-45c2-8498-2d48a2c2648c tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305" status: 200 len: 1718 microversion: 2.20 time: 0.156017 May 23 15:51:50.510687 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 500/1035] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:51:50 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 => generated 1718 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:51:51.528590 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-26d4127d-d5e7-4b47-96f5-aafb2b95e6a3 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:51.529227 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-26d4127d-d5e7-4b47-96f5-aafb2b95e6a3 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:51.535735 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-26d4127d-d5e7-4b47-96f5-aafb2b95e6a3 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:51.536181 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-26d4127d-d5e7-4b47-96f5-aafb2b95e6a3 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:51.536940 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-26d4127d-d5e7-4b47-96f5-aafb2b95e6a3 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:51.537406 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-26d4127d-d5e7-4b47-96f5-aafb2b95e6a3 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:51.666212 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-26d4127d-d5e7-4b47-96f5-aafb2b95e6a3 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:51.674143 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-26d4127d-d5e7-4b47-96f5-aafb2b95e6a3 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:51.676417 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-26d4127d-d5e7-4b47-96f5-aafb2b95e6a3 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:51.677599 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-26d4127d-d5e7-4b47-96f5-aafb2b95e6a3 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305" status: 200 len: 1718 microversion: 2.20 time: 0.152888 May 23 15:51:51.678148 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 536/1036] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:51:51 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 => generated 1718 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:51:52.696459 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-62e3a787-932c-4f3f-9af5-476234e280a2 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:52.696972 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-62e3a787-932c-4f3f-9af5-476234e280a2 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:52.703583 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-62e3a787-932c-4f3f-9af5-476234e280a2 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:52.704045 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-62e3a787-932c-4f3f-9af5-476234e280a2 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:52.704823 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-62e3a787-932c-4f3f-9af5-476234e280a2 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:52.705302 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-62e3a787-932c-4f3f-9af5-476234e280a2 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:52.836883 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-62e3a787-932c-4f3f-9af5-476234e280a2 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:52.844764 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-62e3a787-932c-4f3f-9af5-476234e280a2 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:52.846319 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-62e3a787-932c-4f3f-9af5-476234e280a2 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:52.847479 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-62e3a787-932c-4f3f-9af5-476234e280a2 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305" status: 200 len: 1718 microversion: 2.20 time: 0.155110 May 23 15:51:52.848118 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 501/1037] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:51:52 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 => generated 1718 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:51:53.350748 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [req-0046b319-8b75-4539-8793-c6f0fd28b4f3 req-4e912b3e-c163-4df8-bc16-7ac80a1146bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e0a2baa-19d3-46f7-8585-c5272f971305", "name": "network-vif-unplugged", "status": "completed", "tag": "afbaeb47-bccc-4c5c-8309-2469ca000cc2"}]} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:51:53.359860 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-0046b319-8b75-4539-8793-c6f0fd28b4f3 req-4e912b3e-c163-4df8-bc16-7ac80a1146bd service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:53.360316 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-0046b319-8b75-4539-8793-c6f0fd28b4f3 req-4e912b3e-c163-4df8-bc16-7ac80a1146bd service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:53.371874 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.compute.server_external_events [req-0046b319-8b75-4539-8793-c6f0fd28b4f3 req-4e912b3e-c163-4df8-bc16-7ac80a1146bd service nova] Creating event network-vif-unplugged:afbaeb47-bccc-4c5c-8309-2469ca000cc2 for instance 6e0a2baa-19d3-46f7-8585-c5272f971305 on hv-cinder-84067 May 23 15:51:53.377047 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [req-0046b319-8b75-4539-8793-c6f0fd28b4f3 req-4e912b3e-c163-4df8-bc16-7ac80a1146bd service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030020 May 23 15:51:53.377617 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 537/1038] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:51:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:51:53.866228 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-3d7d5bbc-145b-4928-ba11-97db7f23b5ac tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:53.866870 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-3d7d5bbc-145b-4928-ba11-97db7f23b5ac tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:53.873578 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-3d7d5bbc-145b-4928-ba11-97db7f23b5ac tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:53.874033 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-3d7d5bbc-145b-4928-ba11-97db7f23b5ac tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:53.874848 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-3d7d5bbc-145b-4928-ba11-97db7f23b5ac tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:53.875288 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-3d7d5bbc-145b-4928-ba11-97db7f23b5ac tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:54.003876 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-3d7d5bbc-145b-4928-ba11-97db7f23b5ac tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:54.011841 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-3d7d5bbc-145b-4928-ba11-97db7f23b5ac tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:54.013378 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-3d7d5bbc-145b-4928-ba11-97db7f23b5ac tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:54.014527 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-3d7d5bbc-145b-4928-ba11-97db7f23b5ac tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305" status: 200 len: 1721 microversion: 2.20 time: 0.152640 May 23 15:51:54.015084 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 502/1039] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:51:53 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:51:54.033946 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-65db1b23-a9c4-4cea-a5bd-b28c798dc86b tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b7a0adb-526f-47f6-be30-c765c69fa464"}} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:51:54.035870 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-65db1b23-a9c4-4cea-a5bd-b28c798dc86b tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:54.042566 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-65db1b23-a9c4-4cea-a5bd-b28c798dc86b tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:54.042566 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-65db1b23-a9c4-4cea-a5bd-b28c798dc86b tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:54.043319 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-65db1b23-a9c4-4cea-a5bd-b28c798dc86b tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:54.043754 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-65db1b23-a9c4-4cea-a5bd-b28c798dc86b tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:55.001588 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-65db1b23-a9c4-4cea-a5bd-b28c798dc86b tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "POST /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.971728 May 23 15:51:55.002228 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 538/1040] 10.222.0.64 () {62 vars in 1363 bytes} [Mon May 23 15:51:54 2022] POST /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305/os-volume_attachments => generated 188 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 15:51:55.116175 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-904782c2-c98c-409b-8acb-64ad2d4bfda8 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:55.116678 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-904782c2-c98c-409b-8acb-64ad2d4bfda8 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:55.119195 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:51:55.123902 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-904782c2-c98c-409b-8acb-64ad2d4bfda8 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:55.124358 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-904782c2-c98c-409b-8acb-64ad2d4bfda8 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:55.126724 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-904782c2-c98c-409b-8acb-64ad2d4bfda8 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:55.126724 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-904782c2-c98c-409b-8acb-64ad2d4bfda8 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:55.722029 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-904782c2-c98c-409b-8acb-64ad2d4bfda8 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "DELETE /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305/os-volume_attachments/5b7a0adb-526f-47f6-be30-c765c69fa464" status: 202 len: 0 microversion: 2.20 time: 0.610491 May 23 15:51:55.722629 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 503/1041] 10.222.0.64 () {60 vars in 1456 bytes} [Mon May 23 15:51:55 2022] DELETE /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305/os-volume_attachments/5b7a0adb-526f-47f6-be30-c765c69fa464 => generated 0 bytes in 612 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 23 15:51:55.786193 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-7a599e8b-c016-4e26-9597-52691135c386 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:51:55.786874 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-7a599e8b-c016-4e26-9597-52691135c386 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:55.793823 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-7a599e8b-c016-4e26-9597-52691135c386 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:55.800847 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-7a599e8b-c016-4e26-9597-52691135c386 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:55.800847 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-7a599e8b-c016-4e26-9597-52691135c386 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:55.800847 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-7a599e8b-c016-4e26-9597-52691135c386 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:56.039042 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-7a599e8b-c016-4e26-9597-52691135c386 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "POST /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305/action" status: 202 len: 0 microversion: 2.20 time: 0.256700 May 23 15:51:56.039693 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 539/1042] 10.222.0.64 () {62 vars in 1318 bytes} [Mon May 23 15:51:55 2022] POST /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 23 15:51:56.047988 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-3e6f26e4-c8ed-431f-80c5-20cedcf3f639 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:56.048607 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-3e6f26e4-c8ed-431f-80c5-20cedcf3f639 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:56.055092 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-3e6f26e4-c8ed-431f-80c5-20cedcf3f639 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:56.055551 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-3e6f26e4-c8ed-431f-80c5-20cedcf3f639 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:56.056327 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-3e6f26e4-c8ed-431f-80c5-20cedcf3f639 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:56.056767 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-3e6f26e4-c8ed-431f-80c5-20cedcf3f639 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:56.060730 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:51:56.193599 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-3e6f26e4-c8ed-431f-80c5-20cedcf3f639 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:56.201716 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-3e6f26e4-c8ed-431f-80c5-20cedcf3f639 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:56.203250 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-3e6f26e4-c8ed-431f-80c5-20cedcf3f639 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:56.204425 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-3e6f26e4-c8ed-431f-80c5-20cedcf3f639 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305" status: 200 len: 1669 microversion: 2.20 time: 0.160521 May 23 15:51:56.204984 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 504/1043] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:51:56 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 => generated 1669 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:51:57.224159 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-bbb48c16-63fd-48dc-82f3-7c2177d14329 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:57.224904 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-bbb48c16-63fd-48dc-82f3-7c2177d14329 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:57.231082 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-bbb48c16-63fd-48dc-82f3-7c2177d14329 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:57.231576 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-bbb48c16-63fd-48dc-82f3-7c2177d14329 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:57.232344 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-bbb48c16-63fd-48dc-82f3-7c2177d14329 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:57.232786 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-bbb48c16-63fd-48dc-82f3-7c2177d14329 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:57.362840 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-bbb48c16-63fd-48dc-82f3-7c2177d14329 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:57.371794 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-bbb48c16-63fd-48dc-82f3-7c2177d14329 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:57.373331 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-bbb48c16-63fd-48dc-82f3-7c2177d14329 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:57.377685 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-bbb48c16-63fd-48dc-82f3-7c2177d14329 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305" status: 200 len: 1669 microversion: 2.20 time: 0.155008 May 23 15:51:57.377685 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 540/1044] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:51:57 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 => generated 1669 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:51:58.054635 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-c8d00df7-6db4-438c-a6ec-40c1b9ec56b9 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:58.055135 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-c8d00df7-6db4-438c-a6ec-40c1b9ec56b9 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] [instance: 3c90392f-2134-4f71-aa44-680f7e6f5931] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:58.062330 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c8d00df7-6db4-438c-a6ec-40c1b9ec56b9 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:58.062796 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c8d00df7-6db4-438c-a6ec-40c1b9ec56b9 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:58.063581 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c8d00df7-6db4-438c-a6ec-40c1b9ec56b9 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:58.064025 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-c8d00df7-6db4-438c-a6ec-40c1b9ec56b9 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:58.143504 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.objects.instance [None req-c8d00df7-6db4-438c-a6ec-40c1b9ec56b9 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lazy-loading 'services' on Instance uuid 3c90392f-2134-4f71-aa44-680f7e6f5931 {{(pid=124933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 15:51:58.394917 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-72b7a189-ed79-4075-9989-651a313f76f9 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:58.395839 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-72b7a189-ed79-4075-9989-651a313f76f9 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:58.404192 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-72b7a189-ed79-4075-9989-651a313f76f9 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:58.404651 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-72b7a189-ed79-4075-9989-651a313f76f9 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:58.405748 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-72b7a189-ed79-4075-9989-651a313f76f9 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:58.406128 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-72b7a189-ed79-4075-9989-651a313f76f9 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:58.432797 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-c8d00df7-6db4-438c-a6ec-40c1b9ec56b9 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] 10.222.0.64 "DELETE /compute/v2.1/servers/3c90392f-2134-4f71-aa44-680f7e6f5931/os-volume_attachments/97bfc31a-355e-4c45-bc90-0d9a73388526" status: 202 len: 0 microversion: 2.1 time: 0.381858 May 23 15:51:58.437848 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 505/1045] 10.222.0.64 () {58 vars in 1415 bytes} [Mon May 23 15:51:58 2022] DELETE /compute/v2.1/servers/3c90392f-2134-4f71-aa44-680f7e6f5931/os-volume_attachments/97bfc31a-355e-4c45-bc90-0d9a73388526 => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 15:51:58.653653 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-72b7a189-ed79-4075-9989-651a313f76f9 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:58.661683 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-72b7a189-ed79-4075-9989-651a313f76f9 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:58.663205 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-72b7a189-ed79-4075-9989-651a313f76f9 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:58.664485 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-72b7a189-ed79-4075-9989-651a313f76f9 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305" status: 200 len: 1727 microversion: 2.20 time: 0.274168 May 23 15:51:58.665041 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 541/1046] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:51:58 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 => generated 1727 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 15:51:59.559667 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-a5d45a21-42d0-4c83-8c0b-7a8755347e7a tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:59.560296 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-a5d45a21-42d0-4c83-8c0b-7a8755347e7a tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] [instance: 3c90392f-2134-4f71-aa44-680f7e6f5931] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:59.566617 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a5d45a21-42d0-4c83-8c0b-7a8755347e7a tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:59.567078 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a5d45a21-42d0-4c83-8c0b-7a8755347e7a tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:59.567857 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a5d45a21-42d0-4c83-8c0b-7a8755347e7a tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:59.568457 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a5d45a21-42d0-4c83-8c0b-7a8755347e7a tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:59.597961 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-a5d45a21-42d0-4c83-8c0b-7a8755347e7a tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] [instance: 3c90392f-2134-4f71-aa44-680f7e6f5931] Going to try to terminate instance {{(pid=124933) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 15:51:59.683819 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-e506eb1c-25e2-4fce-89fd-1400446d286e tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:59.684419 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-e506eb1c-25e2-4fce-89fd-1400446d286e tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:59.691692 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e506eb1c-25e2-4fce-89fd-1400446d286e tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:59.692154 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e506eb1c-25e2-4fce-89fd-1400446d286e tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:59.694962 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e506eb1c-25e2-4fce-89fd-1400446d286e tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:59.694962 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e506eb1c-25e2-4fce-89fd-1400446d286e tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:59.699469 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:51:59.885051 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-e506eb1c-25e2-4fce-89fd-1400446d286e tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:59.900530 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-e506eb1c-25e2-4fce-89fd-1400446d286e tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:59.904726 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-e506eb1c-25e2-4fce-89fd-1400446d286e tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:51:59.906010 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-e506eb1c-25e2-4fce-89fd-1400446d286e tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305" status: 200 len: 1727 microversion: 2.20 time: 0.226260 May 23 15:51:59.918898 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 542/1047] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:51:59 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 => generated 1727 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 15:51:59.946432 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-a5d45a21-42d0-4c83-8c0b-7a8755347e7a tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] 10.222.0.64 "DELETE /compute/v2.1/servers/3c90392f-2134-4f71-aa44-680f7e6f5931" status: 204 len: 0 microversion: 2.1 time: 0.391123 May 23 15:51:59.947027 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 506/1048] 10.222.0.64 () {58 vars in 1238 bytes} [Mon May 23 15:51:59 2022] DELETE /compute/v2.1/servers/3c90392f-2134-4f71-aa44-680f7e6f5931 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 23 15:51:59.955649 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-5a6bfafd-63c8-4d1b-a4a6-40dd4d496a7b tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:51:59.956274 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-5a6bfafd-63c8-4d1b-a4a6-40dd4d496a7b tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] [instance: 3c90392f-2134-4f71-aa44-680f7e6f5931] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:51:59.962667 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5a6bfafd-63c8-4d1b-a4a6-40dd4d496a7b tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:59.963326 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5a6bfafd-63c8-4d1b-a4a6-40dd4d496a7b tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:51:59.964294 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5a6bfafd-63c8-4d1b-a4a6-40dd4d496a7b tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:51:59.964904 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-5a6bfafd-63c8-4d1b-a4a6-40dd4d496a7b tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:00.110036 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-5a6bfafd-63c8-4d1b-a4a6-40dd4d496a7b tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c14e93cced14b1b95e2de8fedce31e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c0e4fa5fa246f08bb61703a42e2c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:00.118166 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-5a6bfafd-63c8-4d1b-a4a6-40dd4d496a7b tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] 10.222.0.64 "GET /compute/v2.1/servers/3c90392f-2134-4f71-aa44-680f7e6f5931" status: 200 len: 1514 microversion: 2.1 time: 0.166751 May 23 15:52:00.119047 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 543/1049] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:51:59 2022] GET /compute/v2.1/servers/3c90392f-2134-4f71-aa44-680f7e6f5931 => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:52:00.926148 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-63fcfc70-2188-4862-907b-3489cacd82b9 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:52:00.926858 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-63fcfc70-2188-4862-907b-3489cacd82b9 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:52:00.934817 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-63fcfc70-2188-4862-907b-3489cacd82b9 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:00.935275 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-63fcfc70-2188-4862-907b-3489cacd82b9 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:00.936061 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-63fcfc70-2188-4862-907b-3489cacd82b9 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:00.936503 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-63fcfc70-2188-4862-907b-3489cacd82b9 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:01.070877 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-63fcfc70-2188-4862-907b-3489cacd82b9 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:01.079895 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-63fcfc70-2188-4862-907b-3489cacd82b9 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:01.081473 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-63fcfc70-2188-4862-907b-3489cacd82b9 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:01.082658 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-63fcfc70-2188-4862-907b-3489cacd82b9 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305" status: 200 len: 1727 microversion: 2.20 time: 0.161348 May 23 15:52:01.083211 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 507/1050] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:52:00 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:52:01.136876 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-596a9ae0-7b8c-40aa-b77f-82152ea5ae73 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:52:01.137520 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-596a9ae0-7b8c-40aa-b77f-82152ea5ae73 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] [instance: 3c90392f-2134-4f71-aa44-680f7e6f5931] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:52:01.144120 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-596a9ae0-7b8c-40aa-b77f-82152ea5ae73 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:01.144579 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-596a9ae0-7b8c-40aa-b77f-82152ea5ae73 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:01.145401 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-596a9ae0-7b8c-40aa-b77f-82152ea5ae73 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:01.145842 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-596a9ae0-7b8c-40aa-b77f-82152ea5ae73 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:01.289558 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-596a9ae0-7b8c-40aa-b77f-82152ea5ae73 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c14e93cced14b1b95e2de8fedce31e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c0e4fa5fa246f08bb61703a42e2c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:01.297622 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-596a9ae0-7b8c-40aa-b77f-82152ea5ae73 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] 10.222.0.64 "GET /compute/v2.1/servers/3c90392f-2134-4f71-aa44-680f7e6f5931" status: 200 len: 1514 microversion: 2.1 time: 0.165684 May 23 15:52:01.298431 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 544/1051] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:52:01 2022] GET /compute/v2.1/servers/3c90392f-2134-4f71-aa44-680f7e6f5931 => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:52:02.101113 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-0b3f9e59-ea3c-4634-aaf4-28955d23d16f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:52:02.101844 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-0b3f9e59-ea3c-4634-aaf4-28955d23d16f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:52:02.108582 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-0b3f9e59-ea3c-4634-aaf4-28955d23d16f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:02.109029 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-0b3f9e59-ea3c-4634-aaf4-28955d23d16f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:02.109833 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-0b3f9e59-ea3c-4634-aaf4-28955d23d16f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:02.110275 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-0b3f9e59-ea3c-4634-aaf4-28955d23d16f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:02.247592 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-0b3f9e59-ea3c-4634-aaf4-28955d23d16f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:02.255822 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-0b3f9e59-ea3c-4634-aaf4-28955d23d16f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:02.257385 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-0b3f9e59-ea3c-4634-aaf4-28955d23d16f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:02.258873 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-0b3f9e59-ea3c-4634-aaf4-28955d23d16f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305" status: 200 len: 1727 microversion: 2.20 time: 0.161722 May 23 15:52:02.259647 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 508/1052] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:52:02 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:52:02.317201 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-67fb7777-8ccc-4c39-b7a3-2d19f739da55 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:52:02.318556 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-67fb7777-8ccc-4c39-b7a3-2d19f739da55 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] [instance: 3c90392f-2134-4f71-aa44-680f7e6f5931] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:52:02.325798 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-67fb7777-8ccc-4c39-b7a3-2d19f739da55 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:02.326254 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-67fb7777-8ccc-4c39-b7a3-2d19f739da55 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:02.327043 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-67fb7777-8ccc-4c39-b7a3-2d19f739da55 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:02.327505 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-67fb7777-8ccc-4c39-b7a3-2d19f739da55 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:02.471524 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-67fb7777-8ccc-4c39-b7a3-2d19f739da55 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c14e93cced14b1b95e2de8fedce31e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c0e4fa5fa246f08bb61703a42e2c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:02.479531 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-67fb7777-8ccc-4c39-b7a3-2d19f739da55 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] 10.222.0.64 "GET /compute/v2.1/servers/3c90392f-2134-4f71-aa44-680f7e6f5931" status: 200 len: 1514 microversion: 2.1 time: 0.166217 May 23 15:52:02.480290 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 545/1053] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:52:02 2022] GET /compute/v2.1/servers/3c90392f-2134-4f71-aa44-680f7e6f5931 => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:52:03.277743 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-8b06fb94-ad37-4c96-8ce3-46119093115a tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:52:03.278443 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-8b06fb94-ad37-4c96-8ce3-46119093115a tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:52:03.285038 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-8b06fb94-ad37-4c96-8ce3-46119093115a tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:03.285522 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-8b06fb94-ad37-4c96-8ce3-46119093115a tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:03.286297 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-8b06fb94-ad37-4c96-8ce3-46119093115a tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:03.286739 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-8b06fb94-ad37-4c96-8ce3-46119093115a tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:03.431387 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-8b06fb94-ad37-4c96-8ce3-46119093115a tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:03.440538 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-8b06fb94-ad37-4c96-8ce3-46119093115a tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:03.442069 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-8b06fb94-ad37-4c96-8ce3-46119093115a tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:03.443236 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-8b06fb94-ad37-4c96-8ce3-46119093115a tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305" status: 200 len: 1727 microversion: 2.20 time: 0.170011 May 23 15:52:03.443787 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 509/1054] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:52:03 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 => generated 1727 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:52:03.496008 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-0dd74edb-d929-4556-b61a-14e4bca2a8c7 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:52:03.496644 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-0dd74edb-d929-4556-b61a-14e4bca2a8c7 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] [instance: 3c90392f-2134-4f71-aa44-680f7e6f5931] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:52:03.503016 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0dd74edb-d929-4556-b61a-14e4bca2a8c7 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:03.503468 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0dd74edb-d929-4556-b61a-14e4bca2a8c7 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:03.504514 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0dd74edb-d929-4556-b61a-14e4bca2a8c7 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:03.504958 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0dd74edb-d929-4556-b61a-14e4bca2a8c7 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:03.640198 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-0dd74edb-d929-4556-b61a-14e4bca2a8c7 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c14e93cced14b1b95e2de8fedce31e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c0e4fa5fa246f08bb61703a42e2c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:03.648145 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-0dd74edb-d929-4556-b61a-14e4bca2a8c7 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] 10.222.0.64 "GET /compute/v2.1/servers/3c90392f-2134-4f71-aa44-680f7e6f5931" status: 200 len: 1514 microversion: 2.1 time: 0.156155 May 23 15:52:03.651066 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 546/1055] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:52:03 2022] GET /compute/v2.1/servers/3c90392f-2134-4f71-aa44-680f7e6f5931 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:52:04.462697 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-76e81c6f-2a16-4c07-b822-cbef38b8872b tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:52:04.463309 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-76e81c6f-2a16-4c07-b822-cbef38b8872b tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:52:04.470123 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-76e81c6f-2a16-4c07-b822-cbef38b8872b tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:04.470614 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-76e81c6f-2a16-4c07-b822-cbef38b8872b tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:04.471535 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-76e81c6f-2a16-4c07-b822-cbef38b8872b tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:04.471983 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-76e81c6f-2a16-4c07-b822-cbef38b8872b tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:04.605333 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-76e81c6f-2a16-4c07-b822-cbef38b8872b tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:04.614057 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-76e81c6f-2a16-4c07-b822-cbef38b8872b tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:04.615588 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-76e81c6f-2a16-4c07-b822-cbef38b8872b tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:04.616769 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-76e81c6f-2a16-4c07-b822-cbef38b8872b tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305" status: 200 len: 1727 microversion: 2.20 time: 0.158625 May 23 15:52:04.617362 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 510/1056] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:52:04 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:52:04.667013 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-6f0cb7bf-638c-494d-8f06-754fb93ec150 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:52:04.667636 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-6f0cb7bf-638c-494d-8f06-754fb93ec150 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] [instance: 3c90392f-2134-4f71-aa44-680f7e6f5931] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:52:04.674445 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-6f0cb7bf-638c-494d-8f06-754fb93ec150 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:04.675169 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-6f0cb7bf-638c-494d-8f06-754fb93ec150 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:04.675955 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-6f0cb7bf-638c-494d-8f06-754fb93ec150 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:04.676400 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-6f0cb7bf-638c-494d-8f06-754fb93ec150 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:04.821765 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-6f0cb7bf-638c-494d-8f06-754fb93ec150 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c14e93cced14b1b95e2de8fedce31e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c0e4fa5fa246f08bb61703a42e2c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:04.829691 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-6f0cb7bf-638c-494d-8f06-754fb93ec150 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] 10.222.0.64 "GET /compute/v2.1/servers/3c90392f-2134-4f71-aa44-680f7e6f5931" status: 200 len: 1514 microversion: 2.1 time: 0.167271 May 23 15:52:04.830450 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 547/1057] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:52:04 2022] GET /compute/v2.1/servers/3c90392f-2134-4f71-aa44-680f7e6f5931 => generated 1514 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:52:05.637300 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-486bff84-ce13-4eef-b9c5-b4939826527f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:52:05.637933 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-486bff84-ce13-4eef-b9c5-b4939826527f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:52:05.644405 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-486bff84-ce13-4eef-b9c5-b4939826527f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:05.644845 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-486bff84-ce13-4eef-b9c5-b4939826527f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:05.645625 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-486bff84-ce13-4eef-b9c5-b4939826527f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:05.646060 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-486bff84-ce13-4eef-b9c5-b4939826527f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:05.799174 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-486bff84-ce13-4eef-b9c5-b4939826527f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:05.811417 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-486bff84-ce13-4eef-b9c5-b4939826527f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:05.819312 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-486bff84-ce13-4eef-b9c5-b4939826527f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:05.819312 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-486bff84-ce13-4eef-b9c5-b4939826527f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305" status: 200 len: 1727 microversion: 2.20 time: 0.181716 May 23 15:52:05.819312 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 511/1058] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:52:05 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 => generated 1727 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:52:05.847297 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-eb5804c7-08e0-4d9e-9eed-73b3332a34c3 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:52:05.848065 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-eb5804c7-08e0-4d9e-9eed-73b3332a34c3 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] [instance: 3c90392f-2134-4f71-aa44-680f7e6f5931] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:52:05.850380 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_api:SELECT=50 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:52:05.857519 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-eb5804c7-08e0-4d9e-9eed-73b3332a34c3 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:05.857977 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-eb5804c7-08e0-4d9e-9eed-73b3332a34c3 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:05.858769 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-eb5804c7-08e0-4d9e-9eed-73b3332a34c3 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:05.859270 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-eb5804c7-08e0-4d9e-9eed-73b3332a34c3 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:06.022225 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-eb5804c7-08e0-4d9e-9eed-73b3332a34c3 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c14e93cced14b1b95e2de8fedce31e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c0e4fa5fa246f08bb61703a42e2c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:06.033596 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-eb5804c7-08e0-4d9e-9eed-73b3332a34c3 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] 10.222.0.64 "GET /compute/v2.1/servers/3c90392f-2134-4f71-aa44-680f7e6f5931" status: 200 len: 1514 microversion: 2.1 time: 0.190368 May 23 15:52:06.034540 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 548/1059] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:52:05 2022] GET /compute/v2.1/servers/3c90392f-2134-4f71-aa44-680f7e6f5931 => generated 1514 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:52:06.836250 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-22b5acbc-63e2-48f8-9ebb-77a4506ad6d0 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:52:06.837041 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-22b5acbc-63e2-48f8-9ebb-77a4506ad6d0 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:52:06.844383 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-22b5acbc-63e2-48f8-9ebb-77a4506ad6d0 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:06.849173 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-22b5acbc-63e2-48f8-9ebb-77a4506ad6d0 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:06.849173 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-22b5acbc-63e2-48f8-9ebb-77a4506ad6d0 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:06.849173 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-22b5acbc-63e2-48f8-9ebb-77a4506ad6d0 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:06.986243 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-22b5acbc-63e2-48f8-9ebb-77a4506ad6d0 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:06.996126 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-22b5acbc-63e2-48f8-9ebb-77a4506ad6d0 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:06.997906 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-22b5acbc-63e2-48f8-9ebb-77a4506ad6d0 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:06.999176 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-22b5acbc-63e2-48f8-9ebb-77a4506ad6d0 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305" status: 200 len: 1727 microversion: 2.20 time: 0.166884 May 23 15:52:07.004351 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 512/1060] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:52:06 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:52:07.052019 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-3d61ab38-7198-4c75-8d97-985b3c1c2834 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:52:07.052787 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-3d61ab38-7198-4c75-8d97-985b3c1c2834 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] [instance: 3c90392f-2134-4f71-aa44-680f7e6f5931] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:52:07.060466 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3d61ab38-7198-4c75-8d97-985b3c1c2834 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:07.061102 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3d61ab38-7198-4c75-8d97-985b3c1c2834 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:07.061915 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3d61ab38-7198-4c75-8d97-985b3c1c2834 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:07.062358 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3d61ab38-7198-4c75-8d97-985b3c1c2834 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:07.204939 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-3d61ab38-7198-4c75-8d97-985b3c1c2834 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c14e93cced14b1b95e2de8fedce31e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c0e4fa5fa246f08bb61703a42e2c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:07.213032 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-3d61ab38-7198-4c75-8d97-985b3c1c2834 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] 10.222.0.64 "GET /compute/v2.1/servers/3c90392f-2134-4f71-aa44-680f7e6f5931" status: 200 len: 1514 microversion: 2.1 time: 0.166047 May 23 15:52:07.213643 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 549/1061] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:52:07 2022] GET /compute/v2.1/servers/3c90392f-2134-4f71-aa44-680f7e6f5931 => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:52:08.022722 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-3f0c4e7c-4ff8-4459-95d1-4d60aaed2689 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:52:08.024088 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-3f0c4e7c-4ff8-4459-95d1-4d60aaed2689 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:52:08.030481 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-3f0c4e7c-4ff8-4459-95d1-4d60aaed2689 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:08.030930 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-3f0c4e7c-4ff8-4459-95d1-4d60aaed2689 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:08.031705 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-3f0c4e7c-4ff8-4459-95d1-4d60aaed2689 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:08.032144 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-3f0c4e7c-4ff8-4459-95d1-4d60aaed2689 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:08.167780 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-3f0c4e7c-4ff8-4459-95d1-4d60aaed2689 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:08.177202 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-3f0c4e7c-4ff8-4459-95d1-4d60aaed2689 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:08.178837 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-3f0c4e7c-4ff8-4459-95d1-4d60aaed2689 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:08.180156 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-3f0c4e7c-4ff8-4459-95d1-4d60aaed2689 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305" status: 200 len: 1727 microversion: 2.20 time: 0.161463 May 23 15:52:08.181095 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 513/1062] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:52:08 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:52:08.231250 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-7277ad0a-f1fe-42d8-917c-785549858d47 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:52:08.231959 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-7277ad0a-f1fe-42d8-917c-785549858d47 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] [instance: 3c90392f-2134-4f71-aa44-680f7e6f5931] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:52:08.238464 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-7277ad0a-f1fe-42d8-917c-785549858d47 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:08.238912 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-7277ad0a-f1fe-42d8-917c-785549858d47 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:08.239676 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-7277ad0a-f1fe-42d8-917c-785549858d47 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:08.240115 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-7277ad0a-f1fe-42d8-917c-785549858d47 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:08.390419 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-7277ad0a-f1fe-42d8-917c-785549858d47 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c14e93cced14b1b95e2de8fedce31e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c0e4fa5fa246f08bb61703a42e2c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:08.399144 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-7277ad0a-f1fe-42d8-917c-785549858d47 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] 10.222.0.64 "GET /compute/v2.1/servers/3c90392f-2134-4f71-aa44-680f7e6f5931" status: 200 len: 1514 microversion: 2.1 time: 0.171128 May 23 15:52:08.409503 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 550/1063] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:52:08 2022] GET /compute/v2.1/servers/3c90392f-2134-4f71-aa44-680f7e6f5931 => generated 1514 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:52:09.199867 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-a58817df-2af0-4ef2-8a88-dd9448211bb7 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:52:09.200467 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-a58817df-2af0-4ef2-8a88-dd9448211bb7 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:52:09.206889 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a58817df-2af0-4ef2-8a88-dd9448211bb7 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:09.207339 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a58817df-2af0-4ef2-8a88-dd9448211bb7 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:09.208102 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a58817df-2af0-4ef2-8a88-dd9448211bb7 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:09.208541 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a58817df-2af0-4ef2-8a88-dd9448211bb7 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:09.337756 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-a58817df-2af0-4ef2-8a88-dd9448211bb7 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:09.345582 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-a58817df-2af0-4ef2-8a88-dd9448211bb7 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:09.347093 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-a58817df-2af0-4ef2-8a88-dd9448211bb7 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:09.348240 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-a58817df-2af0-4ef2-8a88-dd9448211bb7 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305" status: 200 len: 1727 microversion: 2.20 time: 0.152961 May 23 15:52:09.348999 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 514/1064] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:52:09 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:52:09.422412 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-2bd50dd1-512e-4fff-a915-ffe1d43b83ff tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:52:09.423020 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-2bd50dd1-512e-4fff-a915-ffe1d43b83ff tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] [instance: 3c90392f-2134-4f71-aa44-680f7e6f5931] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:52:09.429876 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2bd50dd1-512e-4fff-a915-ffe1d43b83ff tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:09.430331 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2bd50dd1-512e-4fff-a915-ffe1d43b83ff tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:09.431109 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2bd50dd1-512e-4fff-a915-ffe1d43b83ff tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:09.431551 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2bd50dd1-512e-4fff-a915-ffe1d43b83ff tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:09.560553 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-2bd50dd1-512e-4fff-a915-ffe1d43b83ff tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c14e93cced14b1b95e2de8fedce31e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c0e4fa5fa246f08bb61703a42e2c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:09.568000 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-2bd50dd1-512e-4fff-a915-ffe1d43b83ff tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] 10.222.0.64 "GET /compute/v2.1/servers/3c90392f-2134-4f71-aa44-680f7e6f5931" status: 200 len: 1514 microversion: 2.1 time: 0.150563 May 23 15:52:09.568554 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 551/1065] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:52:09 2022] GET /compute/v2.1/servers/3c90392f-2134-4f71-aa44-680f7e6f5931 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:52:10.367809 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-5f687a46-1e70-4b86-bb85-bf9ff47032f3 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:52:10.368457 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-5f687a46-1e70-4b86-bb85-bf9ff47032f3 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:52:10.374934 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-5f687a46-1e70-4b86-bb85-bf9ff47032f3 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:10.375388 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-5f687a46-1e70-4b86-bb85-bf9ff47032f3 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:10.376153 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-5f687a46-1e70-4b86-bb85-bf9ff47032f3 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:10.376591 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-5f687a46-1e70-4b86-bb85-bf9ff47032f3 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:10.508358 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-5f687a46-1e70-4b86-bb85-bf9ff47032f3 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:10.516340 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-5f687a46-1e70-4b86-bb85-bf9ff47032f3 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:10.517883 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-5f687a46-1e70-4b86-bb85-bf9ff47032f3 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:10.519066 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-5f687a46-1e70-4b86-bb85-bf9ff47032f3 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305" status: 200 len: 1727 microversion: 2.20 time: 0.155876 May 23 15:52:10.519667 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 515/1066] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:52:10 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:52:10.587286 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-d932fd15-52ab-4d10-8522-24e74e862309 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:52:10.587911 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-d932fd15-52ab-4d10-8522-24e74e862309 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] [instance: 3c90392f-2134-4f71-aa44-680f7e6f5931] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:52:10.594390 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-d932fd15-52ab-4d10-8522-24e74e862309 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:10.594840 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-d932fd15-52ab-4d10-8522-24e74e862309 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:10.595597 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-d932fd15-52ab-4d10-8522-24e74e862309 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:10.596033 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-d932fd15-52ab-4d10-8522-24e74e862309 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:10.723519 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-d932fd15-52ab-4d10-8522-24e74e862309 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c14e93cced14b1b95e2de8fedce31e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c0e4fa5fa246f08bb61703a42e2c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:10.731447 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-d932fd15-52ab-4d10-8522-24e74e862309 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] 10.222.0.64 "GET /compute/v2.1/servers/3c90392f-2134-4f71-aa44-680f7e6f5931" status: 200 len: 1514 microversion: 2.1 time: 0.149509 May 23 15:52:10.732028 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 552/1067] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:52:10 2022] GET /compute/v2.1/servers/3c90392f-2134-4f71-aa44-680f7e6f5931 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:52:11.537324 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-a9a2691e-c5b1-4027-8df3-b40b8d3172a4 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:52:11.537930 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-a9a2691e-c5b1-4027-8df3-b40b8d3172a4 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:52:11.544536 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a9a2691e-c5b1-4027-8df3-b40b8d3172a4 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:11.544981 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a9a2691e-c5b1-4027-8df3-b40b8d3172a4 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:11.545775 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a9a2691e-c5b1-4027-8df3-b40b8d3172a4 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:11.546209 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a9a2691e-c5b1-4027-8df3-b40b8d3172a4 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:11.673689 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-a9a2691e-c5b1-4027-8df3-b40b8d3172a4 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:11.682951 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-a9a2691e-c5b1-4027-8df3-b40b8d3172a4 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:11.684472 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-a9a2691e-c5b1-4027-8df3-b40b8d3172a4 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:11.685663 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-a9a2691e-c5b1-4027-8df3-b40b8d3172a4 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305" status: 200 len: 1727 microversion: 2.20 time: 0.152287 May 23 15:52:11.686223 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 516/1068] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:52:11 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:52:11.748278 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-2e516dc7-72a5-4860-aa82-846566de2d26 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:52:11.748933 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-2e516dc7-72a5-4860-aa82-846566de2d26 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] [instance: 3c90392f-2134-4f71-aa44-680f7e6f5931] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:52:11.755404 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2e516dc7-72a5-4860-aa82-846566de2d26 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:11.755865 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2e516dc7-72a5-4860-aa82-846566de2d26 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:11.756643 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2e516dc7-72a5-4860-aa82-846566de2d26 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:11.757109 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2e516dc7-72a5-4860-aa82-846566de2d26 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:11.886182 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-2e516dc7-72a5-4860-aa82-846566de2d26 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c14e93cced14b1b95e2de8fedce31e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c0e4fa5fa246f08bb61703a42e2c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:11.893612 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-2e516dc7-72a5-4860-aa82-846566de2d26 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] 10.222.0.64 "GET /compute/v2.1/servers/3c90392f-2134-4f71-aa44-680f7e6f5931" status: 200 len: 1514 microversion: 2.1 time: 0.149205 May 23 15:52:11.894176 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 553/1069] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:52:11 2022] GET /compute/v2.1/servers/3c90392f-2134-4f71-aa44-680f7e6f5931 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:52:12.566772 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [req-2c63cee6-5305-44ca-bc01-8d595052e563 req-7e2913f1-c76a-4145-b196-fb6d2447ae52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c90392f-2134-4f71-aa44-680f7e6f5931", "name": "network-vif-deleted", "tag": "f3c0ddf4-94c0-4874-9cd7-6fdd49dfe1f5"}]} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:52:12.577026 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-2c63cee6-5305-44ca-bc01-8d595052e563 req-7e2913f1-c76a-4145-b196-fb6d2447ae52 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:12.577614 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-2c63cee6-5305-44ca-bc01-8d595052e563 req-7e2913f1-c76a-4145-b196-fb6d2447ae52 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:12.588718 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.compute.server_external_events [req-2c63cee6-5305-44ca-bc01-8d595052e563 req-7e2913f1-c76a-4145-b196-fb6d2447ae52 service nova] Creating event network-vif-deleted:f3c0ddf4-94c0-4874-9cd7-6fdd49dfe1f5 for instance 3c90392f-2134-4f71-aa44-680f7e6f5931 on hv-cinder-84067 May 23 15:52:12.593699 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [req-2c63cee6-5305-44ca-bc01-8d595052e563 req-7e2913f1-c76a-4145-b196-fb6d2447ae52 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033434 May 23 15:52:12.594285 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 517/1070] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:52:12.702992 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-43071329-465e-46cd-aab0-f0cb9cc5e1ce tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:52:12.703616 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-43071329-465e-46cd-aab0-f0cb9cc5e1ce tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:52:12.709722 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-43071329-465e-46cd-aab0-f0cb9cc5e1ce tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:12.710176 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-43071329-465e-46cd-aab0-f0cb9cc5e1ce tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:12.710976 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-43071329-465e-46cd-aab0-f0cb9cc5e1ce tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:12.711388 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-43071329-465e-46cd-aab0-f0cb9cc5e1ce tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:12.844662 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-43071329-465e-46cd-aab0-f0cb9cc5e1ce tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:12.853683 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-43071329-465e-46cd-aab0-f0cb9cc5e1ce tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:12.855209 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-43071329-465e-46cd-aab0-f0cb9cc5e1ce tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:12.856690 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-43071329-465e-46cd-aab0-f0cb9cc5e1ce tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305" status: 200 len: 1727 microversion: 2.20 time: 0.157542 May 23 15:52:12.857224 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 554/1071] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:52:12 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:52:12.913096 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-47dc02c4-401b-43d8-b34e-1714b744aa6d tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:52:12.915696 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-47dc02c4-401b-43d8-b34e-1714b744aa6d tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] [instance: 3c90392f-2134-4f71-aa44-680f7e6f5931] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:52:12.922356 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-47dc02c4-401b-43d8-b34e-1714b744aa6d tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:12.922898 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-47dc02c4-401b-43d8-b34e-1714b744aa6d tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:12.923761 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-47dc02c4-401b-43d8-b34e-1714b744aa6d tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:12.924268 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-47dc02c4-401b-43d8-b34e-1714b744aa6d tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:12.963329 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-47dc02c4-401b-43d8-b34e-1714b744aa6d tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:12.963706 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-47dc02c4-401b-43d8-b34e-1714b744aa6d tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:12.964194 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.objects.instance [None req-47dc02c4-401b-43d8-b34e-1714b744aa6d tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lazy-loading 'fault' on Instance uuid 3c90392f-2134-4f71-aa44-680f7e6f5931 {{(pid=124933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 15:52:13.005489 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-47dc02c4-401b-43d8-b34e-1714b744aa6d tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c14e93cced14b1b95e2de8fedce31e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58c0e4fa5fa246f08bb61703a42e2c59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:13.009580 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:52:13.013886 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-47dc02c4-401b-43d8-b34e-1714b744aa6d tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] 10.222.0.64 "GET /compute/v2.1/servers/3c90392f-2134-4f71-aa44-680f7e6f5931" status: 200 len: 1309 microversion: 2.1 time: 0.105676 May 23 15:52:13.014454 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 518/1072] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:52:12 2022] GET /compute/v2.1/servers/3c90392f-2134-4f71-aa44-680f7e6f5931 => generated 1309 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:52:13.874993 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-21a51b20-4937-4170-85d9-c574e3983811 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:52:13.875600 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-21a51b20-4937-4170-85d9-c574e3983811 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:52:13.882141 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-21a51b20-4937-4170-85d9-c574e3983811 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:13.883282 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-21a51b20-4937-4170-85d9-c574e3983811 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:13.884038 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-21a51b20-4937-4170-85d9-c574e3983811 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:13.884474 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-21a51b20-4937-4170-85d9-c574e3983811 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:14.015314 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-21a51b20-4937-4170-85d9-c574e3983811 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:14.023091 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-21a51b20-4937-4170-85d9-c574e3983811 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:14.024741 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-21a51b20-4937-4170-85d9-c574e3983811 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:14.026343 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-21a51b20-4937-4170-85d9-c574e3983811 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305" status: 200 len: 1727 microversion: 2.20 time: 0.154916 May 23 15:52:14.026619 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 555/1073] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:52:13 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:52:14.031221 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-f75d907d-36b6-4f23-b7c8-59811b0423f9 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:52:14.031871 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-f75d907d-36b6-4f23-b7c8-59811b0423f9 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] [instance: 3c90392f-2134-4f71-aa44-680f7e6f5931] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:52:14.039513 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-f75d907d-36b6-4f23-b7c8-59811b0423f9 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:14.040059 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-f75d907d-36b6-4f23-b7c8-59811b0423f9 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:14.040831 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-f75d907d-36b6-4f23-b7c8-59811b0423f9 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:14.041299 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-f75d907d-36b6-4f23-b7c8-59811b0423f9 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:14.055452 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.wsgi [None req-f75d907d-36b6-4f23-b7c8-59811b0423f9 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] HTTP exception thrown: Instance 3c90392f-2134-4f71-aa44-680f7e6f5931 could not be found. May 23 15:52:14.057171 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-f75d907d-36b6-4f23-b7c8-59811b0423f9 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Request method failure captured: May 23 15:52:14.057171 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: request: GET /compute/v2.1/servers/3c90392f-2134-4f71-aa44-680f7e6f5931 HTTP/1.1 May 23 15:52:14.057171 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Accept: application/json May 23 15:52:14.057171 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Accept-Encoding: identity May 23 15:52:14.057171 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Connection: close May 23 15:52:14.057171 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Content-Length: 0 May 23 15:52:14.057171 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Content-Type: application/json May 23 15:52:14.057171 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Host: 10.222.0.64 May 23 15:52:14.057171 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Openstack-System-Scope: None May 23 15:52:14.057171 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: User-Agent: python-urllib3/1.26.9 May 23 15:52:14.057171 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Auth-Token: gAAAAABii60h69bDdN3odUc6LMSCZvlxEO3cMO1-YvoJdrJYCG6O2UnbR44sSu2mKj0BNzFwu3sSVuDdqY18TUZTzo_8J4xMORS7RcZyPsUMg9LJcLgWU1gVmgz75dCNa7pusoRHt1D-pHNjXQqRJrpB3D5xKCQmXKBfWPGR_XyxVWl6glPRkMI May 23 15:52:14.057171 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Domain-Id: None May 23 15:52:14.057171 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Domain-Name: None May 23 15:52:14.057171 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Identity-Status: Confirmed May 23 15:52:14.057171 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Is-Admin-Project: True May 23 15:52:14.057171 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Domain-Id: default May 23 15:52:14.057171 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Domain-Name: Default May 23 15:52:14.057171 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Id: 58c0e4fa5fa246f08bb61703a42e2c59 May 23 15:52:14.057171 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Name: tempest-VolumesSnapshotTestJSON-833324563 May 23 15:52:14.057171 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Role: reader,member May 23 15:52:14.057171 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Roles: reader,member May 23 15:52:14.058912 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/58c0e4fa5fa246f08bb61703a42e2c59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/58c0e4fa5fa246f08bb61703a42e2c59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/58c0e4fa5fa246f08bb61703a42e2c59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_58c0e4fa5fa246f08bb61703a42e2c59", "adminURL": "http://10.222.0.64:8080"}]}] May 23 15:52:14.058912 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant: tempest-VolumesSnapshotTestJSON-833324563 May 23 15:52:14.058912 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant-Id: 58c0e4fa5fa246f08bb61703a42e2c59 May 23 15:52:14.058912 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-833324563 May 23 15:52:14.058912 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User: tempest-VolumesSnapshotTestJSON-833324563-project May 23 15:52:14.058912 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Domain-Id: default May 23 15:52:14.058912 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Domain-Name: Default May 23 15:52:14.058912 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Id: 6c14e93cced14b1b95e2de8fedce31e8 May 23 15:52:14.058912 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Name: tempest-VolumesSnapshotTestJSON-833324563-project May 23 15:52:14.058912 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: method: > May 23 15:52:14.058912 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: exception: Instance 3c90392f-2134-4f71-aa44-680f7e6f5931 could not be found. May 23 15:52:14.058912 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: action_args: {'id': '3c90392f-2134-4f71-aa44-680f7e6f5931'} May 23 15:52:14.059935 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:52:14.059935 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:52:14.059935 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:52:14.059935 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:52:14.059935 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:52:14.059935 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:52:14.059935 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:52:14.059935 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:52:14.059935 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:52:14.059935 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:52:14.059935 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c90392f-2134-4f71-aa44-680f7e6f5931 could not be found. May 23 15:52:14.059935 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:52:14.059935 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:52:14.059935 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:52:14.059935 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:52:14.059935 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:52:14.059935 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:52:14.059935 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:52:14.059935 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:52:14.059935 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:52:14.061640 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:52:14.061640 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 15:52:14.061640 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 15:52:14.061640 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:52:14.061640 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:52:14.061640 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:52:14.061640 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:52:14.061640 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c90392f-2134-4f71-aa44-680f7e6f5931 could not be found. May 23 15:52:14.061640 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:52:14.061640 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:52:14.061640 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:52:14.061640 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:52:14.061640 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:52:14.061640 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:52:14.061640 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:52:14.061640 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:52:14.061640 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c90392f-2134-4f71-aa44-680f7e6f5931 could not be found. May 23 15:52:14.061640 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:52:14.063307 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-f75d907d-36b6-4f23-b7c8-59811b0423f9 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] Returning 404 to user: Instance 3c90392f-2134-4f71-aa44-680f7e6f5931 could not be found. {{(pid=124933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:52:14.063307 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-f75d907d-36b6-4f23-b7c8-59811b0423f9 tempest-VolumesSnapshotTestJSON-833324563 tempest-VolumesSnapshotTestJSON-833324563-project] 10.222.0.64 "GET /compute/v2.1/servers/3c90392f-2134-4f71-aa44-680f7e6f5931" status: 404 len: 111 microversion: 2.1 time: 0.031170 May 23 15:52:14.063307 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 519/1074] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:52:14 2022] GET /compute/v2.1/servers/3c90392f-2134-4f71-aa44-680f7e6f5931 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 23 15:52:14.456049 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [req-da215fa5-3e1d-4bd3-9a63-77cbe0911171 req-9e71039e-2bfe-4f46-acb6-0265cb31ace5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e0a2baa-19d3-46f7-8585-c5272f971305", "name": "network-vif-plugged", "status": "completed", "tag": "afbaeb47-bccc-4c5c-8309-2469ca000cc2"}]} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:52:14.465493 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-da215fa5-3e1d-4bd3-9a63-77cbe0911171 req-9e71039e-2bfe-4f46-acb6-0265cb31ace5 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:14.465948 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-da215fa5-3e1d-4bd3-9a63-77cbe0911171 req-9e71039e-2bfe-4f46-acb6-0265cb31ace5 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:14.481143 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.compute.server_external_events [req-da215fa5-3e1d-4bd3-9a63-77cbe0911171 req-9e71039e-2bfe-4f46-acb6-0265cb31ace5 service nova] Creating event network-vif-plugged:afbaeb47-bccc-4c5c-8309-2469ca000cc2 for instance 6e0a2baa-19d3-46f7-8585-c5272f971305 on hv-cinder-84067 May 23 15:52:14.486161 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [req-da215fa5-3e1d-4bd3-9a63-77cbe0911171 req-9e71039e-2bfe-4f46-acb6-0265cb31ace5 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033845 May 23 15:52:14.486755 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 556/1075] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:52:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:52:15.044519 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-9b3eb73b-eed3-47a5-b07f-ff1d337ef005 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:52:15.045259 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-9b3eb73b-eed3-47a5-b07f-ff1d337ef005 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:52:15.052592 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-9b3eb73b-eed3-47a5-b07f-ff1d337ef005 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:15.053168 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-9b3eb73b-eed3-47a5-b07f-ff1d337ef005 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:15.053960 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-9b3eb73b-eed3-47a5-b07f-ff1d337ef005 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:15.054931 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-9b3eb73b-eed3-47a5-b07f-ff1d337ef005 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:15.180995 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-9b3eb73b-eed3-47a5-b07f-ff1d337ef005 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:15.188921 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-9b3eb73b-eed3-47a5-b07f-ff1d337ef005 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:15.190479 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-9b3eb73b-eed3-47a5-b07f-ff1d337ef005 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:15.191644 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-9b3eb73b-eed3-47a5-b07f-ff1d337ef005 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305" status: 200 len: 1727 microversion: 2.20 time: 0.151459 May 23 15:52:15.192200 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 520/1076] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:52:15 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:52:16.341947 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-272a95b2-2180-4900-8580-10dc9449db69 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:52:16.342661 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-272a95b2-2180-4900-8580-10dc9449db69 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:52:16.348953 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-272a95b2-2180-4900-8580-10dc9449db69 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:16.349639 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-272a95b2-2180-4900-8580-10dc9449db69 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:16.350419 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-272a95b2-2180-4900-8580-10dc9449db69 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:16.350868 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-272a95b2-2180-4900-8580-10dc9449db69 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:16.487452 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-272a95b2-2180-4900-8580-10dc9449db69 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:16.496081 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-272a95b2-2180-4900-8580-10dc9449db69 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:16.497629 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-272a95b2-2180-4900-8580-10dc9449db69 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:16.498888 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-272a95b2-2180-4900-8580-10dc9449db69 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305" status: 200 len: 1727 microversion: 2.20 time: 0.292189 May 23 15:52:16.499527 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 557/1077] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:52:16 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 => generated 1727 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:52:17.517725 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-5cf0a5b6-6819-40b2-98ab-d3bc27baab91 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:52:17.518260 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-5cf0a5b6-6819-40b2-98ab-d3bc27baab91 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:52:17.525601 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-5cf0a5b6-6819-40b2-98ab-d3bc27baab91 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:17.526060 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-5cf0a5b6-6819-40b2-98ab-d3bc27baab91 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:17.526835 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-5cf0a5b6-6819-40b2-98ab-d3bc27baab91 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:17.527280 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-5cf0a5b6-6819-40b2-98ab-d3bc27baab91 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:17.655590 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-5cf0a5b6-6819-40b2-98ab-d3bc27baab91 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:17.663427 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-5cf0a5b6-6819-40b2-98ab-d3bc27baab91 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:17.665685 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-5cf0a5b6-6819-40b2-98ab-d3bc27baab91 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:17.666827 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-5cf0a5b6-6819-40b2-98ab-d3bc27baab91 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305" status: 200 len: 1727 microversion: 2.20 time: 0.153104 May 23 15:52:17.667370 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 521/1078] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:52:17 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:52:18.685801 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-da2be4ea-ae63-4fde-a6bd-026be0f90fb2 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:52:18.686452 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-da2be4ea-ae63-4fde-a6bd-026be0f90fb2 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:52:18.692962 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-da2be4ea-ae63-4fde-a6bd-026be0f90fb2 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:18.693458 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-da2be4ea-ae63-4fde-a6bd-026be0f90fb2 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:18.694392 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-da2be4ea-ae63-4fde-a6bd-026be0f90fb2 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:18.694880 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-da2be4ea-ae63-4fde-a6bd-026be0f90fb2 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:18.824455 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-da2be4ea-ae63-4fde-a6bd-026be0f90fb2 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:18.832376 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-da2be4ea-ae63-4fde-a6bd-026be0f90fb2 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:18.833913 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-da2be4ea-ae63-4fde-a6bd-026be0f90fb2 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:18.835058 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-da2be4ea-ae63-4fde-a6bd-026be0f90fb2 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305" status: 200 len: 1727 microversion: 2.20 time: 0.153241 May 23 15:52:18.836153 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 558/1079] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:52:18 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:52:19.853886 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-66214598-9c8c-4677-9fa1-1af8ebdb310e tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:52:19.854538 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-66214598-9c8c-4677-9fa1-1af8ebdb310e tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:52:19.861905 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-66214598-9c8c-4677-9fa1-1af8ebdb310e tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:19.862366 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-66214598-9c8c-4677-9fa1-1af8ebdb310e tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:19.863317 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-66214598-9c8c-4677-9fa1-1af8ebdb310e tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:19.864073 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-66214598-9c8c-4677-9fa1-1af8ebdb310e tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:20.014027 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-66214598-9c8c-4677-9fa1-1af8ebdb310e tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:20.022247 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-66214598-9c8c-4677-9fa1-1af8ebdb310e tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:20.024062 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-66214598-9c8c-4677-9fa1-1af8ebdb310e tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:20.025273 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-66214598-9c8c-4677-9fa1-1af8ebdb310e tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305" status: 200 len: 1714 microversion: 2.20 time: 0.176057 May 23 15:52:20.025830 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 522/1080] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:52:19 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 => generated 1714 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 15:52:36.467503 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-08ff121d-1ae9-4e80-9b0b-868b257f3877 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:52:36.468048 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-08ff121d-1ae9-4e80-9b0b-868b257f3877 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: 99616012-21ed-48f0-a80e-e08de807a0f7] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:52:36.474894 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:52:36.475649 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_cell1:SELECT=20 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:52:36.482437 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_api:SELECT=21 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:52:36.482437 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_cell1:SELECT=97 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:52:36.485570 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-08ff121d-1ae9-4e80-9b0b-868b257f3877 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:36.486024 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-08ff121d-1ae9-4e80-9b0b-868b257f3877 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:36.486802 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-08ff121d-1ae9-4e80-9b0b-868b257f3877 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:36.487397 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-08ff121d-1ae9-4e80-9b0b-868b257f3877 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:36.514697 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-08ff121d-1ae9-4e80-9b0b-868b257f3877 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: 99616012-21ed-48f0-a80e-e08de807a0f7] Going to try to terminate instance {{(pid=124934) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 15:52:36.545223 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [req-68c5f1a2-3504-4697-92fc-5eab9d0daefe req-ccfa291e-ee89-4e02-a857-4d589f50949b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99616012-21ed-48f0-a80e-e08de807a0f7", "tag": "94b34c73-13bd-4cd4-bab5-10d1f2fcdd65"}]} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:52:36.555174 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-68c5f1a2-3504-4697-92fc-5eab9d0daefe req-ccfa291e-ee89-4e02-a857-4d589f50949b service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:36.555859 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-68c5f1a2-3504-4697-92fc-5eab9d0daefe req-ccfa291e-ee89-4e02-a857-4d589f50949b service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:36.567086 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.compute.server_external_events [req-68c5f1a2-3504-4697-92fc-5eab9d0daefe req-ccfa291e-ee89-4e02-a857-4d589f50949b service nova] Creating event network-changed:94b34c73-13bd-4cd4-bab5-10d1f2fcdd65 for instance 99616012-21ed-48f0-a80e-e08de807a0f7 on hv-cinder-84067 May 23 15:52:36.572180 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [req-68c5f1a2-3504-4697-92fc-5eab9d0daefe req-ccfa291e-ee89-4e02-a857-4d589f50949b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101862 May 23 15:52:36.572772 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 523/1081] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:52:36.910952 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-08ff121d-1ae9-4e80-9b0b-868b257f3877 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "DELETE /compute/v2.1/servers/99616012-21ed-48f0-a80e-e08de807a0f7" status: 204 len: 0 microversion: 2.1 time: 0.447452 May 23 15:52:36.911572 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 559/1082] 10.222.0.64 () {58 vars in 1238 bytes} [Mon May 23 15:52:36 2022] DELETE /compute/v2.1/servers/99616012-21ed-48f0-a80e-e08de807a0f7 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 15:52:36.923053 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-f64648ca-ef71-4f88-a687-1c1be9e6603f tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:52:36.923909 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-f64648ca-ef71-4f88-a687-1c1be9e6603f tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: 99616012-21ed-48f0-a80e-e08de807a0f7] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:52:36.932086 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-f64648ca-ef71-4f88-a687-1c1be9e6603f tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:36.932660 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-f64648ca-ef71-4f88-a687-1c1be9e6603f tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:36.933605 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-f64648ca-ef71-4f88-a687-1c1be9e6603f tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:36.934130 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-f64648ca-ef71-4f88-a687-1c1be9e6603f tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:37.103829 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-f64648ca-ef71-4f88-a687-1c1be9e6603f tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:37.111400 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-f64648ca-ef71-4f88-a687-1c1be9e6603f tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/99616012-21ed-48f0-a80e-e08de807a0f7" status: 200 len: 1579 microversion: 2.1 time: 0.194163 May 23 15:52:37.111955 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 524/1083] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:52:36 2022] GET /compute/v2.1/servers/99616012-21ed-48f0-a80e-e08de807a0f7 => generated 1579 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:52:38.130627 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-a9aba8a5-3ed0-4f00-83c6-47bf56887df8 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:52:38.131163 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-a9aba8a5-3ed0-4f00-83c6-47bf56887df8 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: 99616012-21ed-48f0-a80e-e08de807a0f7] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:52:38.138338 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-a9aba8a5-3ed0-4f00-83c6-47bf56887df8 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:38.138793 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-a9aba8a5-3ed0-4f00-83c6-47bf56887df8 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:38.139576 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-a9aba8a5-3ed0-4f00-83c6-47bf56887df8 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:38.140023 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-a9aba8a5-3ed0-4f00-83c6-47bf56887df8 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:38.270973 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-a9aba8a5-3ed0-4f00-83c6-47bf56887df8 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:38.281773 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-a9aba8a5-3ed0-4f00-83c6-47bf56887df8 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/99616012-21ed-48f0-a80e-e08de807a0f7" status: 200 len: 1579 microversion: 2.1 time: 0.155555 May 23 15:52:38.282348 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 560/1084] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:52:38 2022] GET /compute/v2.1/servers/99616012-21ed-48f0-a80e-e08de807a0f7 => generated 1579 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:52:39.248919 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [req-510aa236-b5d8-4d23-ac57-16759203d249 req-e301ae5e-53d0-46e2-81f2-2f062b67b0d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99616012-21ed-48f0-a80e-e08de807a0f7", "name": "network-vif-deleted", "tag": "94b34c73-13bd-4cd4-bab5-10d1f2fcdd65"}]} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:52:39.256958 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-510aa236-b5d8-4d23-ac57-16759203d249 req-e301ae5e-53d0-46e2-81f2-2f062b67b0d8 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:39.257431 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-510aa236-b5d8-4d23-ac57-16759203d249 req-e301ae5e-53d0-46e2-81f2-2f062b67b0d8 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:39.269712 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.compute.server_external_events [req-510aa236-b5d8-4d23-ac57-16759203d249 req-e301ae5e-53d0-46e2-81f2-2f062b67b0d8 service nova] Creating event network-vif-deleted:94b34c73-13bd-4cd4-bab5-10d1f2fcdd65 for instance 99616012-21ed-48f0-a80e-e08de807a0f7 on hv-cinder-84067 May 23 15:52:39.275141 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [req-510aa236-b5d8-4d23-ac57-16759203d249 req-e301ae5e-53d0-46e2-81f2-2f062b67b0d8 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084209 May 23 15:52:39.276052 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 525/1085] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:52:39.299997 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-021bc4ef-9c16-455b-99ad-d7857a4e4a5c tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:52:39.300682 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-021bc4ef-9c16-455b-99ad-d7857a4e4a5c tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: 99616012-21ed-48f0-a80e-e08de807a0f7] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:52:39.309475 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-021bc4ef-9c16-455b-99ad-d7857a4e4a5c tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:39.309972 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-021bc4ef-9c16-455b-99ad-d7857a4e4a5c tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:39.310861 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-021bc4ef-9c16-455b-99ad-d7857a4e4a5c tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:39.311320 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-021bc4ef-9c16-455b-99ad-d7857a4e4a5c tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:39.376240 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-021bc4ef-9c16-455b-99ad-d7857a4e4a5c tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:39.384445 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-021bc4ef-9c16-455b-99ad-d7857a4e4a5c tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/99616012-21ed-48f0-a80e-e08de807a0f7" status: 200 len: 1392 microversion: 2.1 time: 0.088749 May 23 15:52:39.385002 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 561/1086] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:52:39 2022] GET /compute/v2.1/servers/99616012-21ed-48f0-a80e-e08de807a0f7 => generated 1392 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 15:52:40.402346 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-f88b957e-cd46-48ea-a9ac-250d228b32ad tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:52:40.403060 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-f88b957e-cd46-48ea-a9ac-250d228b32ad tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: 99616012-21ed-48f0-a80e-e08de807a0f7] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:52:40.409384 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-f88b957e-cd46-48ea-a9ac-250d228b32ad tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:40.409836 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-f88b957e-cd46-48ea-a9ac-250d228b32ad tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:40.410612 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-f88b957e-cd46-48ea-a9ac-250d228b32ad tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:40.411052 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-f88b957e-cd46-48ea-a9ac-250d228b32ad tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:40.446968 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-f88b957e-cd46-48ea-a9ac-250d228b32ad tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:40.447600 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-f88b957e-cd46-48ea-a9ac-250d228b32ad tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:40.448058 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.objects.instance [None req-f88b957e-cd46-48ea-a9ac-250d228b32ad tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lazy-loading 'fault' on Instance uuid 99616012-21ed-48f0-a80e-e08de807a0f7 {{(pid=124933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 15:52:40.525755 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-f88b957e-cd46-48ea-a9ac-250d228b32ad tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:40.533402 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-f88b957e-cd46-48ea-a9ac-250d228b32ad tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/99616012-21ed-48f0-a80e-e08de807a0f7" status: 200 len: 1231 microversion: 2.1 time: 0.136309 May 23 15:52:40.533969 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 526/1087] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:52:40 2022] GET /compute/v2.1/servers/99616012-21ed-48f0-a80e-e08de807a0f7 => generated 1231 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:52:41.551869 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-617c0cf3-b753-45bb-846b-0768129f922f tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:52:41.554141 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-617c0cf3-b753-45bb-846b-0768129f922f tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: 99616012-21ed-48f0-a80e-e08de807a0f7] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:52:41.559973 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-617c0cf3-b753-45bb-846b-0768129f922f tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:41.560505 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-617c0cf3-b753-45bb-846b-0768129f922f tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:41.561385 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-617c0cf3-b753-45bb-846b-0768129f922f tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:41.561898 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-617c0cf3-b753-45bb-846b-0768129f922f tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:41.576263 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.wsgi [None req-617c0cf3-b753-45bb-846b-0768129f922f tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] HTTP exception thrown: Instance 99616012-21ed-48f0-a80e-e08de807a0f7 could not be found. May 23 15:52:41.578276 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-617c0cf3-b753-45bb-846b-0768129f922f tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Request method failure captured: May 23 15:52:41.578276 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: request: GET /compute/v2.1/servers/99616012-21ed-48f0-a80e-e08de807a0f7 HTTP/1.1 May 23 15:52:41.578276 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Accept: application/json May 23 15:52:41.578276 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Accept-Encoding: identity May 23 15:52:41.578276 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Connection: close May 23 15:52:41.578276 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Content-Length: 0 May 23 15:52:41.578276 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Content-Type: application/json May 23 15:52:41.578276 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Host: 10.222.0.64 May 23 15:52:41.578276 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Openstack-System-Scope: None May 23 15:52:41.578276 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: User-Agent: python-urllib3/1.26.9 May 23 15:52:41.578276 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Auth-Token: gAAAAABii6wE2FKLZmIEDzTgAa9WVqNGuAuBM4GxXFkOwLZ-Flh_qBqkvDmAt6NTTjKblb93vEokyS0BjtPlh4TqJHS4XW6qlkhQj7h-53hDatZ-dVYeoC-9Ze6Ke0SE_Sg4-M3XrzEBalVYIh8EnctJV8lL5krP2GdTXIxUEeR3aiQR3_eSvso May 23 15:52:41.578276 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Domain-Id: None May 23 15:52:41.578276 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Domain-Name: None May 23 15:52:41.578276 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Identity-Status: Confirmed May 23 15:52:41.578276 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Is-Admin-Project: True May 23 15:52:41.578276 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Domain-Id: default May 23 15:52:41.578276 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Domain-Name: Default May 23 15:52:41.578276 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Id: 6263581d20ea47bcae22d736f7934e05 May 23 15:52:41.578276 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Name: tempest-TestVolumeBootPattern-1449014178 May 23 15:52:41.578276 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Role: reader,member May 23 15:52:41.578276 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Roles: reader,member May 23 15:52:41.580058 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6263581d20ea47bcae22d736f7934e05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/6263581d20ea47bcae22d736f7934e05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6263581d20ea47bcae22d736f7934e05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_6263581d20ea47bcae22d736f7934e05", "adminURL": "http://10.222.0.64:8080"}]}] May 23 15:52:41.580058 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant: tempest-TestVolumeBootPattern-1449014178 May 23 15:52:41.580058 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant-Id: 6263581d20ea47bcae22d736f7934e05 May 23 15:52:41.580058 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant-Name: tempest-TestVolumeBootPattern-1449014178 May 23 15:52:41.580058 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User: tempest-TestVolumeBootPattern-1449014178-project May 23 15:52:41.580058 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Domain-Id: default May 23 15:52:41.580058 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Domain-Name: Default May 23 15:52:41.580058 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Id: ba0229c6732541b4a6dda9040c038686 May 23 15:52:41.580058 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Name: tempest-TestVolumeBootPattern-1449014178-project May 23 15:52:41.580058 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: method: > May 23 15:52:41.580058 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: exception: Instance 99616012-21ed-48f0-a80e-e08de807a0f7 could not be found. May 23 15:52:41.580058 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: action_args: {'id': '99616012-21ed-48f0-a80e-e08de807a0f7'} May 23 15:52:41.581094 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:52:41.581094 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:52:41.581094 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:52:41.581094 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:52:41.581094 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:52:41.581094 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:52:41.581094 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:52:41.581094 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:52:41.581094 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:52:41.581094 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:52:41.581094 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99616012-21ed-48f0-a80e-e08de807a0f7 could not be found. May 23 15:52:41.581094 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:52:41.581094 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:52:41.581094 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:52:41.581094 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:52:41.581094 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:52:41.581094 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:52:41.581094 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:52:41.581094 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:52:41.581094 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:52:41.582725 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:52:41.582725 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 15:52:41.582725 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 15:52:41.582725 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:52:41.582725 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:52:41.582725 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:52:41.582725 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:52:41.582725 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99616012-21ed-48f0-a80e-e08de807a0f7 could not be found. May 23 15:52:41.582725 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:52:41.582725 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:52:41.582725 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:52:41.582725 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:52:41.582725 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:52:41.582725 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:52:41.582725 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:52:41.582725 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:52:41.582725 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99616012-21ed-48f0-a80e-e08de807a0f7 could not be found. May 23 15:52:41.582725 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:52:41.584177 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-617c0cf3-b753-45bb-846b-0768129f922f tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Returning 404 to user: Instance 99616012-21ed-48f0-a80e-e08de807a0f7 could not be found. {{(pid=124934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:52:41.584177 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-617c0cf3-b753-45bb-846b-0768129f922f tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/99616012-21ed-48f0-a80e-e08de807a0f7" status: 404 len: 111 microversion: 2.1 time: 0.032500 May 23 15:52:41.584177 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 562/1088] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:52:41 2022] GET /compute/v2.1/servers/99616012-21ed-48f0-a80e-e08de807a0f7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 15:52:45.081201 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-ffa0791a-4ae5-4fdb-97ce-f13841c071aa tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:52:45.082672 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-ffa0791a-4ae5-4fdb-97ce-f13841c071aa tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: e82853b8-ba61-4e2f-a961-7778da726303] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:52:45.085539 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [req-4526e1d7-1573-4ffa-9c43-6b7085b80a50 req-e21ab4dc-7f26-4b29-ad3b-e796507830df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e82853b8-ba61-4e2f-a961-7778da726303", "tag": "557925ff-a601-4157-8dce-7678d594e516"}]} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:52:45.091013 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ffa0791a-4ae5-4fdb-97ce-f13841c071aa tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:45.091477 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ffa0791a-4ae5-4fdb-97ce-f13841c071aa tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:45.092849 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ffa0791a-4ae5-4fdb-97ce-f13841c071aa tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:45.093549 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ffa0791a-4ae5-4fdb-97ce-f13841c071aa tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:45.109908 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-4526e1d7-1573-4ffa-9c43-6b7085b80a50 req-e21ab4dc-7f26-4b29-ad3b-e796507830df service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:45.110765 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-4526e1d7-1573-4ffa-9c43-6b7085b80a50 req-e21ab4dc-7f26-4b29-ad3b-e796507830df service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:45.124574 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-ffa0791a-4ae5-4fdb-97ce-f13841c071aa tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: e82853b8-ba61-4e2f-a961-7778da726303] Going to try to terminate instance {{(pid=124933) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 15:52:45.131079 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.compute.server_external_events [req-4526e1d7-1573-4ffa-9c43-6b7085b80a50 req-e21ab4dc-7f26-4b29-ad3b-e796507830df service nova] Creating event network-changed:557925ff-a601-4157-8dce-7678d594e516 for instance e82853b8-ba61-4e2f-a961-7778da726303 on hv-cinder-84067 May 23 15:52:45.138041 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [req-4526e1d7-1573-4ffa-9c43-6b7085b80a50 req-e21ab4dc-7f26-4b29-ad3b-e796507830df service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056337 May 23 15:52:45.141241 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 563/1089] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:52:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:52:45.413375 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-ffa0791a-4ae5-4fdb-97ce-f13841c071aa tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "DELETE /compute/v2.1/servers/e82853b8-ba61-4e2f-a961-7778da726303" status: 204 len: 0 microversion: 2.1 time: 0.335944 May 23 15:52:45.414301 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 527/1090] 10.222.0.64 () {58 vars in 1238 bytes} [Mon May 23 15:52:45 2022] DELETE /compute/v2.1/servers/e82853b8-ba61-4e2f-a961-7778da726303 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 15:52:45.423373 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-0b4d8024-709d-4aa9-b625-890838365f0c tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:52:45.424085 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-0b4d8024-709d-4aa9-b625-890838365f0c tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: e82853b8-ba61-4e2f-a961-7778da726303] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:52:45.437384 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0b4d8024-709d-4aa9-b625-890838365f0c tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:45.437845 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0b4d8024-709d-4aa9-b625-890838365f0c tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:45.438645 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0b4d8024-709d-4aa9-b625-890838365f0c tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:45.439125 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0b4d8024-709d-4aa9-b625-890838365f0c tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:45.598910 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-0b4d8024-709d-4aa9-b625-890838365f0c tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:45.608892 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-0b4d8024-709d-4aa9-b625-890838365f0c tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/e82853b8-ba61-4e2f-a961-7778da726303" status: 200 len: 1580 microversion: 2.1 time: 0.188663 May 23 15:52:45.610007 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 564/1091] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:52:45 2022] GET /compute/v2.1/servers/e82853b8-ba61-4e2f-a961-7778da726303 => generated 1580 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:52:46.627421 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-4cfd96cd-2714-46e0-bfc7-45999e27f159 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:52:46.629750 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-4cfd96cd-2714-46e0-bfc7-45999e27f159 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: e82853b8-ba61-4e2f-a961-7778da726303] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:52:46.639734 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-4cfd96cd-2714-46e0-bfc7-45999e27f159 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:46.640942 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-4cfd96cd-2714-46e0-bfc7-45999e27f159 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:46.641777 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-4cfd96cd-2714-46e0-bfc7-45999e27f159 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:46.642690 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-4cfd96cd-2714-46e0-bfc7-45999e27f159 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:46.847463 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-4cfd96cd-2714-46e0-bfc7-45999e27f159 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:46.864396 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-4cfd96cd-2714-46e0-bfc7-45999e27f159 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/e82853b8-ba61-4e2f-a961-7778da726303" status: 200 len: 1580 microversion: 2.1 time: 0.241165 May 23 15:52:46.866718 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 528/1092] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:52:46 2022] GET /compute/v2.1/servers/e82853b8-ba61-4e2f-a961-7778da726303 => generated 1580 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:52:47.718396 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [req-ca72f886-2d96-49f0-a772-70305c4513ca req-041ae290-08f7-4d70-84cf-5a4e92180dad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e82853b8-ba61-4e2f-a961-7778da726303", "name": "network-vif-deleted", "tag": "557925ff-a601-4157-8dce-7678d594e516"}]} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:52:47.731642 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-ca72f886-2d96-49f0-a772-70305c4513ca req-041ae290-08f7-4d70-84cf-5a4e92180dad service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:47.732097 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-ca72f886-2d96-49f0-a772-70305c4513ca req-041ae290-08f7-4d70-84cf-5a4e92180dad service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:47.745471 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.compute.server_external_events [req-ca72f886-2d96-49f0-a772-70305c4513ca req-041ae290-08f7-4d70-84cf-5a4e92180dad service nova] Creating event network-vif-deleted:557925ff-a601-4157-8dce-7678d594e516 for instance e82853b8-ba61-4e2f-a961-7778da726303 on hv-cinder-84067 May 23 15:52:47.755410 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [req-ca72f886-2d96-49f0-a772-70305c4513ca req-041ae290-08f7-4d70-84cf-5a4e92180dad service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040852 May 23 15:52:47.756017 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 565/1093] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:52:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:52:47.886920 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-855b767a-7927-4491-b91f-138167a01319 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:52:47.887534 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-855b767a-7927-4491-b91f-138167a01319 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: e82853b8-ba61-4e2f-a961-7778da726303] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:52:47.897441 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-855b767a-7927-4491-b91f-138167a01319 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:47.898181 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-855b767a-7927-4491-b91f-138167a01319 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:47.899656 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-855b767a-7927-4491-b91f-138167a01319 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:47.900156 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-855b767a-7927-4491-b91f-138167a01319 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:48.013409 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-855b767a-7927-4491-b91f-138167a01319 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:48.031155 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-855b767a-7927-4491-b91f-138167a01319 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/e82853b8-ba61-4e2f-a961-7778da726303" status: 200 len: 1226 microversion: 2.1 time: 0.150770 May 23 15:52:48.034383 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 529/1094] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:52:47 2022] GET /compute/v2.1/servers/e82853b8-ba61-4e2f-a961-7778da726303 => generated 1226 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:52:49.050292 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-d8d31446-159d-4033-9087-d81de00403c7 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:52:49.051034 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-d8d31446-159d-4033-9087-d81de00403c7 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: e82853b8-ba61-4e2f-a961-7778da726303] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:52:49.057596 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-d8d31446-159d-4033-9087-d81de00403c7 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:49.058147 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-d8d31446-159d-4033-9087-d81de00403c7 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:49.058931 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-d8d31446-159d-4033-9087-d81de00403c7 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:49.059812 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-d8d31446-159d-4033-9087-d81de00403c7 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:49.093016 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-d8d31446-159d-4033-9087-d81de00403c7 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:49.093498 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-d8d31446-159d-4033-9087-d81de00403c7 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:49.093941 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.objects.instance [None req-d8d31446-159d-4033-9087-d81de00403c7 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lazy-loading 'fault' on Instance uuid e82853b8-ba61-4e2f-a961-7778da726303 {{(pid=124934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 15:52:49.142213 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-d8d31446-159d-4033-9087-d81de00403c7 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba0229c6732541b4a6dda9040c038686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6263581d20ea47bcae22d736f7934e05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:49.151468 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-d8d31446-159d-4033-9087-d81de00403c7 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/e82853b8-ba61-4e2f-a961-7778da726303" status: 200 len: 1231 microversion: 2.1 time: 0.106126 May 23 15:52:49.155509 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 566/1095] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:52:49 2022] GET /compute/v2.1/servers/e82853b8-ba61-4e2f-a961-7778da726303 => generated 1231 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:52:50.174787 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-a7c7c9f0-d531-44ee-8d6a-7815329f9ebb tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:52:50.175459 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-a7c7c9f0-d531-44ee-8d6a-7815329f9ebb tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: e82853b8-ba61-4e2f-a961-7778da726303] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:52:50.182749 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a7c7c9f0-d531-44ee-8d6a-7815329f9ebb tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:50.184547 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a7c7c9f0-d531-44ee-8d6a-7815329f9ebb tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:50.185446 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a7c7c9f0-d531-44ee-8d6a-7815329f9ebb tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:50.185950 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a7c7c9f0-d531-44ee-8d6a-7815329f9ebb tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:50.200549 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.wsgi [None req-a7c7c9f0-d531-44ee-8d6a-7815329f9ebb tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] HTTP exception thrown: Instance e82853b8-ba61-4e2f-a961-7778da726303 could not be found. May 23 15:52:50.202180 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-a7c7c9f0-d531-44ee-8d6a-7815329f9ebb tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Request method failure captured: May 23 15:52:50.202180 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: request: GET /compute/v2.1/servers/e82853b8-ba61-4e2f-a961-7778da726303 HTTP/1.1 May 23 15:52:50.202180 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Accept: application/json May 23 15:52:50.202180 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Accept-Encoding: identity May 23 15:52:50.202180 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Connection: close May 23 15:52:50.202180 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Content-Length: 0 May 23 15:52:50.202180 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Content-Type: application/json May 23 15:52:50.202180 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Host: 10.222.0.64 May 23 15:52:50.202180 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Openstack-System-Scope: None May 23 15:52:50.202180 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: User-Agent: python-urllib3/1.26.9 May 23 15:52:50.202180 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Auth-Token: gAAAAABii6wE2FKLZmIEDzTgAa9WVqNGuAuBM4GxXFkOwLZ-Flh_qBqkvDmAt6NTTjKblb93vEokyS0BjtPlh4TqJHS4XW6qlkhQj7h-53hDatZ-dVYeoC-9Ze6Ke0SE_Sg4-M3XrzEBalVYIh8EnctJV8lL5krP2GdTXIxUEeR3aiQR3_eSvso May 23 15:52:50.202180 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Domain-Id: None May 23 15:52:50.202180 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Domain-Name: None May 23 15:52:50.202180 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Identity-Status: Confirmed May 23 15:52:50.202180 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Is-Admin-Project: True May 23 15:52:50.202180 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Domain-Id: default May 23 15:52:50.202180 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Domain-Name: Default May 23 15:52:50.202180 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Id: 6263581d20ea47bcae22d736f7934e05 May 23 15:52:50.202180 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Name: tempest-TestVolumeBootPattern-1449014178 May 23 15:52:50.202180 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Role: reader,member May 23 15:52:50.202180 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Roles: reader,member May 23 15:52:50.203878 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6263581d20ea47bcae22d736f7934e05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/6263581d20ea47bcae22d736f7934e05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6263581d20ea47bcae22d736f7934e05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_6263581d20ea47bcae22d736f7934e05", "adminURL": "http://10.222.0.64:8080"}]}] May 23 15:52:50.203878 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant: tempest-TestVolumeBootPattern-1449014178 May 23 15:52:50.203878 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant-Id: 6263581d20ea47bcae22d736f7934e05 May 23 15:52:50.203878 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant-Name: tempest-TestVolumeBootPattern-1449014178 May 23 15:52:50.203878 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User: tempest-TestVolumeBootPattern-1449014178-project May 23 15:52:50.203878 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Domain-Id: default May 23 15:52:50.203878 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Domain-Name: Default May 23 15:52:50.203878 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Id: ba0229c6732541b4a6dda9040c038686 May 23 15:52:50.203878 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Name: tempest-TestVolumeBootPattern-1449014178-project May 23 15:52:50.203878 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: method: > May 23 15:52:50.203878 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: exception: Instance e82853b8-ba61-4e2f-a961-7778da726303 could not be found. May 23 15:52:50.203878 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: action_args: {'id': 'e82853b8-ba61-4e2f-a961-7778da726303'} May 23 15:52:50.204746 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:52:50.204746 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:52:50.204746 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:52:50.204746 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:52:50.204746 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:52:50.204746 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:52:50.204746 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:52:50.204746 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:52:50.204746 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:52:50.204746 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:52:50.204746 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e82853b8-ba61-4e2f-a961-7778da726303 could not be found. May 23 15:52:50.204746 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:52:50.204746 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:52:50.204746 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:52:50.204746 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:52:50.204746 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:52:50.204746 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:52:50.204746 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:52:50.204746 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:52:50.204746 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:52:50.206088 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:52:50.206088 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 15:52:50.206088 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 15:52:50.206088 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:52:50.206088 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:52:50.206088 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:52:50.206088 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:52:50.206088 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e82853b8-ba61-4e2f-a961-7778da726303 could not be found. May 23 15:52:50.206088 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:52:50.206088 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:52:50.206088 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:52:50.206088 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:52:50.206088 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:52:50.206088 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:52:50.206088 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:52:50.206088 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:52:50.206088 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e82853b8-ba61-4e2f-a961-7778da726303 could not be found. May 23 15:52:50.206088 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:52:50.207215 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-a7c7c9f0-d531-44ee-8d6a-7815329f9ebb tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Returning 404 to user: Instance e82853b8-ba61-4e2f-a961-7778da726303 could not be found. {{(pid=124933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:52:50.207215 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-a7c7c9f0-d531-44ee-8d6a-7815329f9ebb tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/e82853b8-ba61-4e2f-a961-7778da726303" status: 404 len: 111 microversion: 2.1 time: 0.033419 May 23 15:52:50.207215 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 530/1096] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:52:50 2022] GET /compute/v2.1/servers/e82853b8-ba61-4e2f-a961-7778da726303 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 15:52:51.126414 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-032c7fde-72bc-4aa2-857e-2f1df83899c2 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:52:51.127583 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-032c7fde-72bc-4aa2-857e-2f1df83899c2 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: 54ec3019-6a8e-4080-a386-3894a165c7eb] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:52:51.135221 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-032c7fde-72bc-4aa2-857e-2f1df83899c2 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:51.135684 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-032c7fde-72bc-4aa2-857e-2f1df83899c2 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:51.137787 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-032c7fde-72bc-4aa2-857e-2f1df83899c2 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:51.138241 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-032c7fde-72bc-4aa2-857e-2f1df83899c2 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:51.153160 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.wsgi [None req-032c7fde-72bc-4aa2-857e-2f1df83899c2 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] HTTP exception thrown: Instance 54ec3019-6a8e-4080-a386-3894a165c7eb could not be found. May 23 15:52:51.154791 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-032c7fde-72bc-4aa2-857e-2f1df83899c2 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Request method failure captured: May 23 15:52:51.154791 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: request: DELETE /compute/v2.1/servers/54ec3019-6a8e-4080-a386-3894a165c7eb HTTP/1.1 May 23 15:52:51.154791 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Accept: application/json May 23 15:52:51.154791 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Accept-Encoding: identity May 23 15:52:51.154791 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Connection: close May 23 15:52:51.154791 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Content-Length: 0 May 23 15:52:51.154791 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Content-Type: application/json May 23 15:52:51.154791 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Host: 10.222.0.64 May 23 15:52:51.154791 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Openstack-System-Scope: None May 23 15:52:51.154791 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: User-Agent: python-urllib3/1.26.9 May 23 15:52:51.154791 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Auth-Token: gAAAAABii6wE2FKLZmIEDzTgAa9WVqNGuAuBM4GxXFkOwLZ-Flh_qBqkvDmAt6NTTjKblb93vEokyS0BjtPlh4TqJHS4XW6qlkhQj7h-53hDatZ-dVYeoC-9Ze6Ke0SE_Sg4-M3XrzEBalVYIh8EnctJV8lL5krP2GdTXIxUEeR3aiQR3_eSvso May 23 15:52:51.154791 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Domain-Id: None May 23 15:52:51.154791 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Domain-Name: None May 23 15:52:51.154791 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Identity-Status: Confirmed May 23 15:52:51.154791 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Is-Admin-Project: True May 23 15:52:51.154791 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Domain-Id: default May 23 15:52:51.154791 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Domain-Name: Default May 23 15:52:51.154791 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Id: 6263581d20ea47bcae22d736f7934e05 May 23 15:52:51.154791 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Name: tempest-TestVolumeBootPattern-1449014178 May 23 15:52:51.154791 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Role: reader,member May 23 15:52:51.154791 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Roles: reader,member May 23 15:52:51.156466 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6263581d20ea47bcae22d736f7934e05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/6263581d20ea47bcae22d736f7934e05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6263581d20ea47bcae22d736f7934e05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_6263581d20ea47bcae22d736f7934e05", "adminURL": "http://10.222.0.64:8080"}]}] May 23 15:52:51.156466 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant: tempest-TestVolumeBootPattern-1449014178 May 23 15:52:51.156466 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant-Id: 6263581d20ea47bcae22d736f7934e05 May 23 15:52:51.156466 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant-Name: tempest-TestVolumeBootPattern-1449014178 May 23 15:52:51.156466 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User: tempest-TestVolumeBootPattern-1449014178-project May 23 15:52:51.156466 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Domain-Id: default May 23 15:52:51.156466 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Domain-Name: Default May 23 15:52:51.156466 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Id: ba0229c6732541b4a6dda9040c038686 May 23 15:52:51.156466 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Name: tempest-TestVolumeBootPattern-1449014178-project May 23 15:52:51.156466 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: method: > May 23 15:52:51.156466 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: exception: Instance 54ec3019-6a8e-4080-a386-3894a165c7eb could not be found. May 23 15:52:51.156466 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: action_args: {'id': '54ec3019-6a8e-4080-a386-3894a165c7eb'} May 23 15:52:51.167692 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:52:51.167692 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:52:51.167692 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:52:51.167692 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:52:51.167692 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:52:51.167692 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:52:51.167692 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:52:51.167692 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:52:51.167692 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:52:51.167692 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:52:51.167692 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54ec3019-6a8e-4080-a386-3894a165c7eb could not be found. May 23 15:52:51.167692 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:52:51.167692 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:52:51.167692 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:52:51.167692 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:52:51.167692 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:52:51.167692 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:52:51.167692 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:52:51.167692 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:52:51.167692 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:52:51.169192 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:52:51.169192 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 15:52:51.169192 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 15:52:51.169192 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 15:52:51.169192 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 15:52:51.169192 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:52:51.169192 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:52:51.169192 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:52:51.169192 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:52:51.169192 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54ec3019-6a8e-4080-a386-3894a165c7eb could not be found. May 23 15:52:51.169192 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:52:51.169192 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:52:51.169192 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:52:51.169192 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:52:51.169192 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:52:51.169192 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:52:51.169192 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:52:51.169192 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:52:51.169192 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54ec3019-6a8e-4080-a386-3894a165c7eb could not be found. May 23 15:52:51.169192 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:52:51.170482 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-032c7fde-72bc-4aa2-857e-2f1df83899c2 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Returning 404 to user: Instance 54ec3019-6a8e-4080-a386-3894a165c7eb could not be found. {{(pid=124934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:52:51.170482 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-032c7fde-72bc-4aa2-857e-2f1df83899c2 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "DELETE /compute/v2.1/servers/54ec3019-6a8e-4080-a386-3894a165c7eb" status: 404 len: 111 microversion: 2.1 time: 0.034572 May 23 15:52:51.170482 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 567/1097] 10.222.0.64 () {58 vars in 1238 bytes} [Mon May 23 15:52:51 2022] DELETE /compute/v2.1/servers/54ec3019-6a8e-4080-a386-3894a165c7eb => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 23 15:52:51.170733 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-ea8aaad0-0287-4901-b61c-a95b936c9114 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:52:51.170733 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-ea8aaad0-0287-4901-b61c-a95b936c9114 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] [instance: 54ec3019-6a8e-4080-a386-3894a165c7eb] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:52:51.172694 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ea8aaad0-0287-4901-b61c-a95b936c9114 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:51.173253 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ea8aaad0-0287-4901-b61c-a95b936c9114 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:51.174084 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ea8aaad0-0287-4901-b61c-a95b936c9114 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:51.174898 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ea8aaad0-0287-4901-b61c-a95b936c9114 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:51.195569 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.wsgi [None req-ea8aaad0-0287-4901-b61c-a95b936c9114 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] HTTP exception thrown: Instance 54ec3019-6a8e-4080-a386-3894a165c7eb could not be found. May 23 15:52:51.195569 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-ea8aaad0-0287-4901-b61c-a95b936c9114 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Request method failure captured: May 23 15:52:51.195569 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: request: GET /compute/v2.1/servers/54ec3019-6a8e-4080-a386-3894a165c7eb HTTP/1.1 May 23 15:52:51.195569 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Accept: application/json May 23 15:52:51.195569 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Accept-Encoding: identity May 23 15:52:51.195569 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Connection: close May 23 15:52:51.195569 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Content-Length: 0 May 23 15:52:51.195569 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Content-Type: application/json May 23 15:52:51.195569 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Host: 10.222.0.64 May 23 15:52:51.195569 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Openstack-System-Scope: None May 23 15:52:51.195569 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: User-Agent: python-urllib3/1.26.9 May 23 15:52:51.195569 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Auth-Token: gAAAAABii6wE2FKLZmIEDzTgAa9WVqNGuAuBM4GxXFkOwLZ-Flh_qBqkvDmAt6NTTjKblb93vEokyS0BjtPlh4TqJHS4XW6qlkhQj7h-53hDatZ-dVYeoC-9Ze6Ke0SE_Sg4-M3XrzEBalVYIh8EnctJV8lL5krP2GdTXIxUEeR3aiQR3_eSvso May 23 15:52:51.195569 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Domain-Id: None May 23 15:52:51.195569 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Domain-Name: None May 23 15:52:51.195569 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Identity-Status: Confirmed May 23 15:52:51.195569 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Is-Admin-Project: True May 23 15:52:51.195569 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Domain-Id: default May 23 15:52:51.195569 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Domain-Name: Default May 23 15:52:51.195569 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Id: 6263581d20ea47bcae22d736f7934e05 May 23 15:52:51.195569 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Name: tempest-TestVolumeBootPattern-1449014178 May 23 15:52:51.195569 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Role: reader,member May 23 15:52:51.195569 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Roles: reader,member May 23 15:52:51.197395 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6263581d20ea47bcae22d736f7934e05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/6263581d20ea47bcae22d736f7934e05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6263581d20ea47bcae22d736f7934e05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_6263581d20ea47bcae22d736f7934e05", "adminURL": "http://10.222.0.64:8080"}]}] May 23 15:52:51.197395 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant: tempest-TestVolumeBootPattern-1449014178 May 23 15:52:51.197395 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant-Id: 6263581d20ea47bcae22d736f7934e05 May 23 15:52:51.197395 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant-Name: tempest-TestVolumeBootPattern-1449014178 May 23 15:52:51.197395 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User: tempest-TestVolumeBootPattern-1449014178-project May 23 15:52:51.197395 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Domain-Id: default May 23 15:52:51.197395 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Domain-Name: Default May 23 15:52:51.197395 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Id: ba0229c6732541b4a6dda9040c038686 May 23 15:52:51.197395 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Name: tempest-TestVolumeBootPattern-1449014178-project May 23 15:52:51.197395 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: method: > May 23 15:52:51.197395 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: exception: Instance 54ec3019-6a8e-4080-a386-3894a165c7eb could not be found. May 23 15:52:51.197395 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: action_args: {'id': '54ec3019-6a8e-4080-a386-3894a165c7eb'} May 23 15:52:51.198217 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:52:51.198217 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:52:51.198217 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:52:51.198217 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:52:51.198217 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:52:51.198217 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:52:51.198217 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:52:51.198217 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:52:51.198217 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:52:51.198217 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:52:51.198217 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54ec3019-6a8e-4080-a386-3894a165c7eb could not be found. May 23 15:52:51.198217 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:52:51.198217 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:52:51.198217 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:52:51.198217 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:52:51.198217 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:52:51.198217 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:52:51.198217 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:52:51.198217 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:52:51.198217 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:52:51.200438 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:52:51.200438 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 15:52:51.200438 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 15:52:51.200438 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:52:51.200438 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:52:51.200438 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:52:51.200438 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:52:51.200438 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54ec3019-6a8e-4080-a386-3894a165c7eb could not be found. May 23 15:52:51.200438 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:52:51.200438 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:52:51.200438 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:52:51.200438 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:52:51.200438 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:52:51.200438 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:52:51.200438 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:52:51.200438 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:52:51.200438 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54ec3019-6a8e-4080-a386-3894a165c7eb could not be found. May 23 15:52:51.200438 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:52:51.202726 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-ea8aaad0-0287-4901-b61c-a95b936c9114 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Returning 404 to user: Instance 54ec3019-6a8e-4080-a386-3894a165c7eb could not be found. {{(pid=124933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:52:51.202726 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-ea8aaad0-0287-4901-b61c-a95b936c9114 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "GET /compute/v2.1/servers/54ec3019-6a8e-4080-a386-3894a165c7eb" status: 404 len: 111 microversion: 2.1 time: 0.033442 May 23 15:52:51.202726 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 531/1098] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:52:51 2022] GET /compute/v2.1/servers/54ec3019-6a8e-4080-a386-3894a165c7eb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 15:52:52.768753 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-ec6a6619-0b87-4f1a-b74f-36db98979afe tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:52:52.775815 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-ec6a6619-0b87-4f1a-b74f-36db98979afe tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:52:52.785231 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ec6a6619-0b87-4f1a-b74f-36db98979afe tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:52.790611 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ec6a6619-0b87-4f1a-b74f-36db98979afe tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:52.791838 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ec6a6619-0b87-4f1a-b74f-36db98979afe tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:52.793757 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ec6a6619-0b87-4f1a-b74f-36db98979afe tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:52.887050 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-ec6a6619-0b87-4f1a-b74f-36db98979afe tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.123778 May 23 15:52:52.887629 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 568/1099] 10.222.0.64 () {60 vars in 1342 bytes} [Mon May 23 15:52:52 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305/os-volume_attachments => generated 25 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:52:52.970013 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-b1590a92-1525-435d-aca2-bfa65ba833c1 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:52:52.970013 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-b1590a92-1525-435d-aca2-bfa65ba833c1 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:52:52.977314 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-069db1fd-ed59-4aa5-9aed-a18a6756d6e4 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] Calling method '.version_select at 0x7fab51eb51f0>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:52:52.979463 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b1590a92-1525-435d-aca2-bfa65ba833c1 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:52.980241 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b1590a92-1525-435d-aca2-bfa65ba833c1 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:52.981104 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b1590a92-1525-435d-aca2-bfa65ba833c1 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:52.981538 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b1590a92-1525-435d-aca2-bfa65ba833c1 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:53.041777 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-b1590a92-1525-435d-aca2-bfa65ba833c1 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Going to try to terminate instance {{(pid=124933) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 15:52:53.105835 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-069db1fd-ed59-4aa5-9aed-a18a6756d6e4 tempest-TestVolumeBootPattern-1449014178 tempest-TestVolumeBootPattern-1449014178-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1689259836" status: 202 len: 0 microversion: 2.1 time: 0.132514 May 23 15:52:53.116258 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 569/1100] 10.222.0.64 () {58 vars in 1262 bytes} [Mon May 23 15:52:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1689259836 => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 23 15:52:53.343836 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-b1590a92-1525-435d-aca2-bfa65ba833c1 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "DELETE /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305" status: 204 len: 0 microversion: 2.20 time: 0.386718 May 23 15:52:53.344342 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 532/1101] 10.222.0.64 () {60 vars in 1279 bytes} [Mon May 23 15:52:52 2022] DELETE /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 23 15:52:53.353427 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-7922bf07-2924-4aaf-8bfc-39213306ce8f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:52:53.354485 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-7922bf07-2924-4aaf-8bfc-39213306ce8f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:52:53.361434 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-7922bf07-2924-4aaf-8bfc-39213306ce8f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:53.362044 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-7922bf07-2924-4aaf-8bfc-39213306ce8f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:53.362906 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-7922bf07-2924-4aaf-8bfc-39213306ce8f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:53.363445 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-7922bf07-2924-4aaf-8bfc-39213306ce8f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:53.617343 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-7922bf07-2924-4aaf-8bfc-39213306ce8f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:53.628633 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-7922bf07-2924-4aaf-8bfc-39213306ce8f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:53.634976 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-7922bf07-2924-4aaf-8bfc-39213306ce8f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:53.639686 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-7922bf07-2924-4aaf-8bfc-39213306ce8f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305" status: 200 len: 1720 microversion: 2.20 time: 0.290751 May 23 15:52:53.641390 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 570/1102] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:52:53 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 => generated 1720 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:52:54.659861 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-dbbb5845-eeb8-4bdf-aba1-3760caec4e6f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:52:54.660565 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-dbbb5845-eeb8-4bdf-aba1-3760caec4e6f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:52:54.667446 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-dbbb5845-eeb8-4bdf-aba1-3760caec4e6f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:54.667909 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-dbbb5845-eeb8-4bdf-aba1-3760caec4e6f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:54.668752 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-dbbb5845-eeb8-4bdf-aba1-3760caec4e6f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:54.669232 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-dbbb5845-eeb8-4bdf-aba1-3760caec4e6f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:55.077576 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-dbbb5845-eeb8-4bdf-aba1-3760caec4e6f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:55.100315 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-dbbb5845-eeb8-4bdf-aba1-3760caec4e6f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:55.102291 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-dbbb5845-eeb8-4bdf-aba1-3760caec4e6f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:55.104026 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-dbbb5845-eeb8-4bdf-aba1-3760caec4e6f tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305" status: 200 len: 1720 microversion: 2.20 time: 0.448484 May 23 15:52:55.106514 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 533/1103] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:52:54 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 => generated 1720 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:52:56.123269 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-c23ceff8-7ee6-4230-a57b-b77eee2a4616 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:52:56.125900 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-c23ceff8-7ee6-4230-a57b-b77eee2a4616 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:52:56.150720 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-c23ceff8-7ee6-4230-a57b-b77eee2a4616 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:56.151185 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-c23ceff8-7ee6-4230-a57b-b77eee2a4616 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:56.152552 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-c23ceff8-7ee6-4230-a57b-b77eee2a4616 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:56.153144 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-c23ceff8-7ee6-4230-a57b-b77eee2a4616 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:56.644383 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-c23ceff8-7ee6-4230-a57b-b77eee2a4616 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:56.654671 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-c23ceff8-7ee6-4230-a57b-b77eee2a4616 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:56.658560 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-c23ceff8-7ee6-4230-a57b-b77eee2a4616 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:56.669285 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-c23ceff8-7ee6-4230-a57b-b77eee2a4616 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305" status: 200 len: 1653 microversion: 2.20 time: 0.550093 May 23 15:52:56.680198 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 571/1104] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:52:56 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 => generated 1653 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:52:56.898927 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [req-e3e35274-9edf-4a10-883a-1efd9c1519ce req-549f0541-eb66-4524-a766-04cb346b4930 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e0a2baa-19d3-46f7-8585-c5272f971305", "name": "network-vif-deleted", "tag": "afbaeb47-bccc-4c5c-8309-2469ca000cc2"}]} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:52:56.919132 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-e3e35274-9edf-4a10-883a-1efd9c1519ce req-549f0541-eb66-4524-a766-04cb346b4930 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:56.919852 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-e3e35274-9edf-4a10-883a-1efd9c1519ce req-549f0541-eb66-4524-a766-04cb346b4930 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:56.936123 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.compute.server_external_events [req-e3e35274-9edf-4a10-883a-1efd9c1519ce req-549f0541-eb66-4524-a766-04cb346b4930 service nova] Creating event network-vif-deleted:afbaeb47-bccc-4c5c-8309-2469ca000cc2 for instance 6e0a2baa-19d3-46f7-8585-c5272f971305 on hv-cinder-84067 May 23 15:52:56.947105 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [req-e3e35274-9edf-4a10-883a-1efd9c1519ce req-549f0541-eb66-4524-a766-04cb346b4930 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051095 May 23 15:52:56.950020 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 534/1105] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:52:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:52:57.688322 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-b290fa85-c398-4d02-b565-72b75455b065 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:52:57.689640 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-b290fa85-c398-4d02-b565-72b75455b065 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:52:57.716742 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-b290fa85-c398-4d02-b565-72b75455b065 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:57.723073 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-b290fa85-c398-4d02-b565-72b75455b065 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:57.724450 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-b290fa85-c398-4d02-b565-72b75455b065 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:57.727425 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-b290fa85-c398-4d02-b565-72b75455b065 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:57.773122 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-b290fa85-c398-4d02-b565-72b75455b065 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:57.773609 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-b290fa85-c398-4d02-b565-72b75455b065 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:57.774054 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.objects.instance [None req-b290fa85-c398-4d02-b565-72b75455b065 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lazy-loading 'fault' on Instance uuid 6e0a2baa-19d3-46f7-8585-c5272f971305 {{(pid=124934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 15:52:57.836672 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-b290fa85-c398-4d02-b565-72b75455b065 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:57.845866 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-b290fa85-c398-4d02-b565-72b75455b065 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:57.847663 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-b290fa85-c398-4d02-b565-72b75455b065 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a5fc191f3464ffe83d5fde2419cb8b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749e4849b23b4e42be64ef0ab0330a0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:52:57.849496 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-b290fa85-c398-4d02-b565-72b75455b065 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305" status: 200 len: 1370 microversion: 2.20 time: 0.164788 May 23 15:52:57.850313 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 572/1106] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:52:57 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 => generated 1370 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 15:52:58.869698 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-b1177bb7-5aef-4ae8-b540-e74ea8e249c1 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:52:58.870875 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-b1177bb7-5aef-4ae8-b540-e74ea8e249c1 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:52:58.884776 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b1177bb7-5aef-4ae8-b540-e74ea8e249c1 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:58.886676 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b1177bb7-5aef-4ae8-b540-e74ea8e249c1 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:58.887477 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b1177bb7-5aef-4ae8-b540-e74ea8e249c1 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:52:58.887914 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-b1177bb7-5aef-4ae8-b540-e74ea8e249c1 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:52:58.914697 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.wsgi [None req-b1177bb7-5aef-4ae8-b540-e74ea8e249c1 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] HTTP exception thrown: Instance 6e0a2baa-19d3-46f7-8585-c5272f971305 could not be found. May 23 15:52:58.915760 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-b1177bb7-5aef-4ae8-b540-e74ea8e249c1 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Request method failure captured: May 23 15:52:58.915760 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: request: GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 HTTP/1.1 May 23 15:52:58.915760 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Accept: application/json May 23 15:52:58.915760 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Accept-Encoding: identity May 23 15:52:58.915760 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Connection: close May 23 15:52:58.915760 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Content-Length: 0 May 23 15:52:58.915760 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Content-Type: application/json May 23 15:52:58.915760 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Host: 10.222.0.64 May 23 15:52:58.915760 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Openstack-System-Scope: None May 23 15:52:58.915760 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: User-Agent: python-urllib3/1.26.9 May 23 15:52:58.915760 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Auth-Token: gAAAAABii6yD677URC8Wr3a-Me9HgLrk9MN-kVk73UomYhEw3NQaqrmysijC6sCthK-zBBWIX5OOisctblImVKmhiCFxEy-UN7m1EPD2NDi9T6xal8nU9psILVaIeCep9NXPy7v95R6W-3Oju79domZJ9BQ2ZunRFBQnQM3WqUPbcfYJUOb6j3A May 23 15:52:58.915760 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Domain-Id: None May 23 15:52:58.915760 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Domain-Name: None May 23 15:52:58.915760 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Identity-Status: Confirmed May 23 15:52:58.915760 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Is-Admin-Project: True May 23 15:52:58.915760 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Openstack-Nova-Api-Version: 2.20 May 23 15:52:58.915760 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Domain-Id: default May 23 15:52:58.915760 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Domain-Name: Default May 23 15:52:58.915760 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Id: 749e4849b23b4e42be64ef0ab0330a0b May 23 15:52:58.915760 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-963625688 May 23 15:52:58.915760 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Role: reader,member May 23 15:52:58.915760 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Roles: reader,member May 23 15:52:58.918091 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/749e4849b23b4e42be64ef0ab0330a0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/749e4849b23b4e42be64ef0ab0330a0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/749e4849b23b4e42be64ef0ab0330a0b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_749e4849b23b4e42be64ef0ab0330a0b", "adminURL": "http://10.222.0.64:8080"}]}] May 23 15:52:58.918091 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant: tempest-AttachVolumeShelveTestJSON-963625688 May 23 15:52:58.918091 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant-Id: 749e4849b23b4e42be64ef0ab0330a0b May 23 15:52:58.918091 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-963625688 May 23 15:52:58.918091 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User: tempest-AttachVolumeShelveTestJSON-963625688-project May 23 15:52:58.918091 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Domain-Id: default May 23 15:52:58.918091 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Domain-Name: Default May 23 15:52:58.918091 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Id: 7a5fc191f3464ffe83d5fde2419cb8b4 May 23 15:52:58.918091 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Name: tempest-AttachVolumeShelveTestJSON-963625688-project May 23 15:52:58.918091 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: method: > May 23 15:52:58.918091 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: exception: Instance 6e0a2baa-19d3-46f7-8585-c5272f971305 could not be found. May 23 15:52:58.918091 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: action_args: {'id': '6e0a2baa-19d3-46f7-8585-c5272f971305'} May 23 15:52:58.919276 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:52:58.919276 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:52:58.919276 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:52:58.919276 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:52:58.919276 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:52:58.919276 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:52:58.919276 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:52:58.919276 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:52:58.919276 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:52:58.919276 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:52:58.919276 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e0a2baa-19d3-46f7-8585-c5272f971305 could not be found. May 23 15:52:58.919276 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:52:58.919276 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:52:58.919276 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:52:58.919276 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:52:58.919276 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:52:58.919276 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:52:58.919276 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:52:58.919276 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:52:58.919276 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:52:58.921004 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:52:58.921004 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 15:52:58.921004 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 15:52:58.921004 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:52:58.921004 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:52:58.921004 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:52:58.921004 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:52:58.921004 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e0a2baa-19d3-46f7-8585-c5272f971305 could not be found. May 23 15:52:58.921004 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:52:58.921004 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:52:58.921004 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:52:58.921004 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:52:58.921004 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:52:58.921004 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:52:58.921004 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:52:58.921004 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:52:58.921004 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e0a2baa-19d3-46f7-8585-c5272f971305 could not be found. May 23 15:52:58.921004 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:52:58.923483 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-b1177bb7-5aef-4ae8-b540-e74ea8e249c1 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Returning 404 to user: Instance 6e0a2baa-19d3-46f7-8585-c5272f971305 could not be found. {{(pid=124933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:52:58.939030 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-b1177bb7-5aef-4ae8-b540-e74ea8e249c1 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305" status: 404 len: 111 microversion: 2.20 time: 0.070096 May 23 15:52:58.939030 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 535/1107] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:52:58 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 23 15:52:58.947820 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-7fb370e2-1503-43d3-9dce-70f2ae60dae2 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '.version_select at 0x7fab57099160>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:52:59.020953 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-7fb370e2-1503-43d3-9dce-70f2ae60dae2 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-76584187" status: 204 len: 0 microversion: 2.20 time: 0.076238 May 23 15:52:59.020953 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 573/1108] 10.222.0.64 () {60 vars in 1255 bytes} [Mon May 23 15:52:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-76584187 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 23 15:53:01.856016 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-f58ee6de-9774-4668-a5f5-57c5a8febc7b tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:53:01.859468 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-f58ee6de-9774-4668-a5f5-57c5a8febc7b tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:53:01.874257 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-f58ee6de-9774-4668-a5f5-57c5a8febc7b tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:53:01.874716 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-f58ee6de-9774-4668-a5f5-57c5a8febc7b tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:53:01.875513 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-f58ee6de-9774-4668-a5f5-57c5a8febc7b tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:53:01.875949 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-f58ee6de-9774-4668-a5f5-57c5a8febc7b tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:53:01.896743 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.wsgi [None req-f58ee6de-9774-4668-a5f5-57c5a8febc7b tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] HTTP exception thrown: Instance 6e0a2baa-19d3-46f7-8585-c5272f971305 could not be found. May 23 15:53:01.896743 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-f58ee6de-9774-4668-a5f5-57c5a8febc7b tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Request method failure captured: May 23 15:53:01.896743 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: request: DELETE /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 HTTP/1.1 May 23 15:53:01.896743 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Accept: application/json May 23 15:53:01.896743 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Accept-Encoding: identity May 23 15:53:01.896743 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Connection: close May 23 15:53:01.896743 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Content-Length: 0 May 23 15:53:01.896743 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Content-Type: application/json May 23 15:53:01.896743 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Host: 10.222.0.64 May 23 15:53:01.896743 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Openstack-System-Scope: None May 23 15:53:01.896743 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: User-Agent: python-urllib3/1.26.9 May 23 15:53:01.896743 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Auth-Token: gAAAAABii6yD677URC8Wr3a-Me9HgLrk9MN-kVk73UomYhEw3NQaqrmysijC6sCthK-zBBWIX5OOisctblImVKmhiCFxEy-UN7m1EPD2NDi9T6xal8nU9psILVaIeCep9NXPy7v95R6W-3Oju79domZJ9BQ2ZunRFBQnQM3WqUPbcfYJUOb6j3A May 23 15:53:01.896743 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Domain-Id: None May 23 15:53:01.896743 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Domain-Name: None May 23 15:53:01.896743 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Identity-Status: Confirmed May 23 15:53:01.896743 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Is-Admin-Project: True May 23 15:53:01.896743 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Openstack-Nova-Api-Version: 2.20 May 23 15:53:01.896743 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Domain-Id: default May 23 15:53:01.896743 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Domain-Name: Default May 23 15:53:01.896743 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Id: 749e4849b23b4e42be64ef0ab0330a0b May 23 15:53:01.896743 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-963625688 May 23 15:53:01.896743 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Role: reader,member May 23 15:53:01.896743 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Roles: reader,member May 23 15:53:01.898625 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/749e4849b23b4e42be64ef0ab0330a0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/749e4849b23b4e42be64ef0ab0330a0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/749e4849b23b4e42be64ef0ab0330a0b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_749e4849b23b4e42be64ef0ab0330a0b", "adminURL": "http://10.222.0.64:8080"}]}] May 23 15:53:01.898625 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant: tempest-AttachVolumeShelveTestJSON-963625688 May 23 15:53:01.898625 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant-Id: 749e4849b23b4e42be64ef0ab0330a0b May 23 15:53:01.898625 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-963625688 May 23 15:53:01.898625 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User: tempest-AttachVolumeShelveTestJSON-963625688-project May 23 15:53:01.898625 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Domain-Id: default May 23 15:53:01.898625 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Domain-Name: Default May 23 15:53:01.898625 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Id: 7a5fc191f3464ffe83d5fde2419cb8b4 May 23 15:53:01.898625 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Name: tempest-AttachVolumeShelveTestJSON-963625688-project May 23 15:53:01.898625 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: method: > May 23 15:53:01.898625 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: exception: Instance 6e0a2baa-19d3-46f7-8585-c5272f971305 could not be found. May 23 15:53:01.898625 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: action_args: {'id': '6e0a2baa-19d3-46f7-8585-c5272f971305'} May 23 15:53:01.899594 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:53:01.899594 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:53:01.899594 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:53:01.899594 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:53:01.899594 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:53:01.899594 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:53:01.899594 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:53:01.899594 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:53:01.899594 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:53:01.899594 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:53:01.899594 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e0a2baa-19d3-46f7-8585-c5272f971305 could not be found. May 23 15:53:01.899594 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:53:01.899594 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:53:01.899594 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:53:01.899594 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:53:01.899594 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:53:01.899594 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:53:01.899594 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:53:01.899594 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:53:01.899594 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:53:01.901195 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:53:01.901195 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 15:53:01.901195 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 15:53:01.901195 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 15:53:01.901195 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 15:53:01.901195 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:53:01.901195 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:53:01.901195 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:53:01.901195 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:53:01.901195 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e0a2baa-19d3-46f7-8585-c5272f971305 could not be found. May 23 15:53:01.901195 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:53:01.901195 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:53:01.901195 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:53:01.901195 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:53:01.901195 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:53:01.901195 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:53:01.901195 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:53:01.901195 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:53:01.901195 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e0a2baa-19d3-46f7-8585-c5272f971305 could not be found. May 23 15:53:01.901195 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:53:01.903432 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-f58ee6de-9774-4668-a5f5-57c5a8febc7b tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Returning 404 to user: Instance 6e0a2baa-19d3-46f7-8585-c5272f971305 could not be found. {{(pid=124933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:53:01.903432 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-f58ee6de-9774-4668-a5f5-57c5a8febc7b tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "DELETE /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305" status: 404 len: 111 microversion: 2.20 time: 0.044045 May 23 15:53:01.904375 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-b567c4e1-f5d6-4dd1-b60e-dad3eb9131b5 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:53:01.904865 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-b567c4e1-f5d6-4dd1-b60e-dad3eb9131b5 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 6e0a2baa-19d3-46f7-8585-c5272f971305] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:53:01.912330 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 536/1109] 10.222.0.64 () {60 vars in 1279 bytes} [Mon May 23 15:53:01 2022] DELETE /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 23 15:53:01.919359 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-b567c4e1-f5d6-4dd1-b60e-dad3eb9131b5 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:53:01.920095 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-b567c4e1-f5d6-4dd1-b60e-dad3eb9131b5 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:53:01.921273 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-b567c4e1-f5d6-4dd1-b60e-dad3eb9131b5 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:53:01.921897 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-b567c4e1-f5d6-4dd1-b60e-dad3eb9131b5 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:53:01.951833 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.wsgi [None req-b567c4e1-f5d6-4dd1-b60e-dad3eb9131b5 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] HTTP exception thrown: Instance 6e0a2baa-19d3-46f7-8585-c5272f971305 could not be found. May 23 15:53:01.961167 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-b567c4e1-f5d6-4dd1-b60e-dad3eb9131b5 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Request method failure captured: May 23 15:53:01.961167 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: request: GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 HTTP/1.1 May 23 15:53:01.961167 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Accept: application/json May 23 15:53:01.961167 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Accept-Encoding: identity May 23 15:53:01.961167 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Connection: close May 23 15:53:01.961167 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Content-Length: 0 May 23 15:53:01.961167 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Content-Type: application/json May 23 15:53:01.961167 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Host: 10.222.0.64 May 23 15:53:01.961167 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Openstack-System-Scope: None May 23 15:53:01.961167 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: User-Agent: python-urllib3/1.26.9 May 23 15:53:01.961167 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Auth-Token: gAAAAABii6yD677URC8Wr3a-Me9HgLrk9MN-kVk73UomYhEw3NQaqrmysijC6sCthK-zBBWIX5OOisctblImVKmhiCFxEy-UN7m1EPD2NDi9T6xal8nU9psILVaIeCep9NXPy7v95R6W-3Oju79domZJ9BQ2ZunRFBQnQM3WqUPbcfYJUOb6j3A May 23 15:53:01.961167 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Domain-Id: None May 23 15:53:01.961167 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Domain-Name: None May 23 15:53:01.961167 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Identity-Status: Confirmed May 23 15:53:01.961167 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Is-Admin-Project: True May 23 15:53:01.961167 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Openstack-Nova-Api-Version: 2.20 May 23 15:53:01.961167 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Domain-Id: default May 23 15:53:01.961167 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Domain-Name: Default May 23 15:53:01.961167 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Id: 749e4849b23b4e42be64ef0ab0330a0b May 23 15:53:01.961167 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-963625688 May 23 15:53:01.961167 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Role: reader,member May 23 15:53:01.961167 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Roles: reader,member May 23 15:53:01.963629 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/749e4849b23b4e42be64ef0ab0330a0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/749e4849b23b4e42be64ef0ab0330a0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/749e4849b23b4e42be64ef0ab0330a0b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_749e4849b23b4e42be64ef0ab0330a0b", "adminURL": "http://10.222.0.64:8080"}]}] May 23 15:53:01.963629 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant: tempest-AttachVolumeShelveTestJSON-963625688 May 23 15:53:01.963629 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant-Id: 749e4849b23b4e42be64ef0ab0330a0b May 23 15:53:01.963629 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-963625688 May 23 15:53:01.963629 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User: tempest-AttachVolumeShelveTestJSON-963625688-project May 23 15:53:01.963629 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Domain-Id: default May 23 15:53:01.963629 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Domain-Name: Default May 23 15:53:01.963629 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Id: 7a5fc191f3464ffe83d5fde2419cb8b4 May 23 15:53:01.963629 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Name: tempest-AttachVolumeShelveTestJSON-963625688-project May 23 15:53:01.963629 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: method: > May 23 15:53:01.963629 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: exception: Instance 6e0a2baa-19d3-46f7-8585-c5272f971305 could not be found. May 23 15:53:01.963629 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: action_args: {'id': '6e0a2baa-19d3-46f7-8585-c5272f971305'} May 23 15:53:01.964649 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:53:01.964649 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:53:01.964649 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:53:01.964649 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:53:01.964649 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:53:01.964649 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:53:01.964649 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:53:01.964649 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:53:01.964649 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:53:01.964649 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:53:01.964649 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e0a2baa-19d3-46f7-8585-c5272f971305 could not be found. May 23 15:53:01.964649 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:53:01.964649 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:53:01.964649 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:53:01.964649 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:53:01.964649 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:53:01.964649 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:53:01.964649 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:53:01.964649 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:53:01.964649 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:53:01.966284 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:53:01.966284 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 15:53:01.966284 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 15:53:01.966284 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:53:01.966284 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:53:01.966284 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:53:01.966284 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:53:01.966284 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e0a2baa-19d3-46f7-8585-c5272f971305 could not be found. May 23 15:53:01.966284 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:53:01.966284 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:53:01.966284 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:53:01.966284 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:53:01.966284 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:53:01.966284 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:53:01.966284 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:53:01.966284 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:53:01.966284 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e0a2baa-19d3-46f7-8585-c5272f971305 could not be found. May 23 15:53:01.966284 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:53:01.967674 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-b567c4e1-f5d6-4dd1-b60e-dad3eb9131b5 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Returning 404 to user: Instance 6e0a2baa-19d3-46f7-8585-c5272f971305 could not be found. {{(pid=124934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:53:01.967674 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-b567c4e1-f5d6-4dd1-b60e-dad3eb9131b5 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305" status: 404 len: 111 microversion: 2.20 time: 0.054745 May 23 15:53:01.967674 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 574/1110] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:53:01 2022] GET /compute/v2.1/servers/6e0a2baa-19d3-46f7-8585-c5272f971305 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 23 15:53:03.623516 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-5a09ac59-dfe7-4a48-8643-5703793530d4 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:53:03.624042 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-5a09ac59-dfe7-4a48-8643-5703793530d4 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:53:03.631538 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-5a09ac59-dfe7-4a48-8643-5703793530d4 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:53:03.635440 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-5a09ac59-dfe7-4a48-8643-5703793530d4 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:53:03.639139 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-5a09ac59-dfe7-4a48-8643-5703793530d4 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:53:03.639680 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-5a09ac59-dfe7-4a48-8643-5703793530d4 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:53:03.654880 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.wsgi [None req-5a09ac59-dfe7-4a48-8643-5703793530d4 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] HTTP exception thrown: Instance 9d9a9391-45aa-4e87-b025-839d2bf5c8a3 could not be found. May 23 15:53:03.656812 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-5a09ac59-dfe7-4a48-8643-5703793530d4 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Request method failure captured: May 23 15:53:03.656812 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: request: DELETE /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 HTTP/1.1 May 23 15:53:03.656812 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Accept: application/json May 23 15:53:03.656812 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Accept-Encoding: identity May 23 15:53:03.656812 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Connection: close May 23 15:53:03.656812 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Content-Length: 0 May 23 15:53:03.656812 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Content-Type: application/json May 23 15:53:03.656812 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Host: 10.222.0.64 May 23 15:53:03.656812 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Openstack-System-Scope: None May 23 15:53:03.656812 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: User-Agent: python-urllib3/1.26.9 May 23 15:53:03.656812 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Auth-Token: gAAAAABii6yD677URC8Wr3a-Me9HgLrk9MN-kVk73UomYhEw3NQaqrmysijC6sCthK-zBBWIX5OOisctblImVKmhiCFxEy-UN7m1EPD2NDi9T6xal8nU9psILVaIeCep9NXPy7v95R6W-3Oju79domZJ9BQ2ZunRFBQnQM3WqUPbcfYJUOb6j3A May 23 15:53:03.656812 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Domain-Id: None May 23 15:53:03.656812 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Domain-Name: None May 23 15:53:03.656812 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Identity-Status: Confirmed May 23 15:53:03.656812 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Is-Admin-Project: True May 23 15:53:03.656812 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Openstack-Nova-Api-Version: 2.20 May 23 15:53:03.656812 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Domain-Id: default May 23 15:53:03.656812 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Domain-Name: Default May 23 15:53:03.656812 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Id: 749e4849b23b4e42be64ef0ab0330a0b May 23 15:53:03.656812 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-963625688 May 23 15:53:03.656812 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Role: reader,member May 23 15:53:03.656812 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Roles: reader,member May 23 15:53:03.658754 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/749e4849b23b4e42be64ef0ab0330a0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/749e4849b23b4e42be64ef0ab0330a0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/749e4849b23b4e42be64ef0ab0330a0b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_749e4849b23b4e42be64ef0ab0330a0b", "adminURL": "http://10.222.0.64:8080"}]}] May 23 15:53:03.658754 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant: tempest-AttachVolumeShelveTestJSON-963625688 May 23 15:53:03.658754 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant-Id: 749e4849b23b4e42be64ef0ab0330a0b May 23 15:53:03.658754 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-963625688 May 23 15:53:03.658754 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User: tempest-AttachVolumeShelveTestJSON-963625688-project May 23 15:53:03.658754 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Domain-Id: default May 23 15:53:03.658754 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Domain-Name: Default May 23 15:53:03.658754 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Id: 7a5fc191f3464ffe83d5fde2419cb8b4 May 23 15:53:03.658754 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Name: tempest-AttachVolumeShelveTestJSON-963625688-project May 23 15:53:03.658754 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: method: > May 23 15:53:03.658754 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: exception: Instance 9d9a9391-45aa-4e87-b025-839d2bf5c8a3 could not be found. May 23 15:53:03.658754 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: action_args: {'id': '9d9a9391-45aa-4e87-b025-839d2bf5c8a3'} May 23 15:53:03.659724 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:53:03.659724 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:53:03.659724 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:53:03.659724 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:53:03.659724 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:53:03.659724 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:53:03.659724 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:53:03.659724 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:53:03.659724 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:53:03.659724 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:53:03.659724 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d9a9391-45aa-4e87-b025-839d2bf5c8a3 could not be found. May 23 15:53:03.659724 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:53:03.659724 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:53:03.659724 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:53:03.659724 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:53:03.659724 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:53:03.659724 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:53:03.659724 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:53:03.659724 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:53:03.659724 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:53:03.661323 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:53:03.661323 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 15:53:03.661323 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 15:53:03.661323 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 15:53:03.661323 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 15:53:03.661323 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:53:03.661323 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:53:03.661323 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:53:03.661323 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:53:03.661323 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d9a9391-45aa-4e87-b025-839d2bf5c8a3 could not be found. May 23 15:53:03.661323 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:53:03.661323 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:53:03.661323 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:53:03.661323 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:53:03.661323 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:53:03.661323 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:53:03.661323 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:53:03.661323 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:53:03.661323 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d9a9391-45aa-4e87-b025-839d2bf5c8a3 could not be found. May 23 15:53:03.661323 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:53:03.664939 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-5a09ac59-dfe7-4a48-8643-5703793530d4 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Returning 404 to user: Instance 9d9a9391-45aa-4e87-b025-839d2bf5c8a3 could not be found. {{(pid=124933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:53:03.664939 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-5a09ac59-dfe7-4a48-8643-5703793530d4 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "DELETE /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 404 len: 111 microversion: 2.20 time: 0.045130 May 23 15:53:03.673096 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-dea8d428-32a7-4e06-96f7-5911520cae37 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:53:03.673719 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-dea8d428-32a7-4e06-96f7-5911520cae37 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] [instance: 9d9a9391-45aa-4e87-b025-839d2bf5c8a3] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:53:03.680700 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-dea8d428-32a7-4e06-96f7-5911520cae37 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:53:03.683623 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 537/1111] 10.222.0.64 () {60 vars in 1279 bytes} [Mon May 23 15:53:03 2022] DELETE /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 23 15:53:03.685325 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-dea8d428-32a7-4e06-96f7-5911520cae37 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:53:03.686535 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-dea8d428-32a7-4e06-96f7-5911520cae37 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:53:03.687135 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-dea8d428-32a7-4e06-96f7-5911520cae37 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:53:03.705460 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.wsgi [None req-dea8d428-32a7-4e06-96f7-5911520cae37 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] HTTP exception thrown: Instance 9d9a9391-45aa-4e87-b025-839d2bf5c8a3 could not be found. May 23 15:53:03.707399 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-dea8d428-32a7-4e06-96f7-5911520cae37 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Request method failure captured: May 23 15:53:03.707399 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: request: GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 HTTP/1.1 May 23 15:53:03.707399 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Accept: application/json May 23 15:53:03.707399 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Accept-Encoding: identity May 23 15:53:03.707399 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Connection: close May 23 15:53:03.707399 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Content-Length: 0 May 23 15:53:03.707399 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Content-Type: application/json May 23 15:53:03.707399 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Host: 10.222.0.64 May 23 15:53:03.707399 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Openstack-System-Scope: None May 23 15:53:03.707399 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: User-Agent: python-urllib3/1.26.9 May 23 15:53:03.707399 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Auth-Token: gAAAAABii6yD677URC8Wr3a-Me9HgLrk9MN-kVk73UomYhEw3NQaqrmysijC6sCthK-zBBWIX5OOisctblImVKmhiCFxEy-UN7m1EPD2NDi9T6xal8nU9psILVaIeCep9NXPy7v95R6W-3Oju79domZJ9BQ2ZunRFBQnQM3WqUPbcfYJUOb6j3A May 23 15:53:03.707399 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Domain-Id: None May 23 15:53:03.707399 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Domain-Name: None May 23 15:53:03.707399 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Identity-Status: Confirmed May 23 15:53:03.707399 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Is-Admin-Project: True May 23 15:53:03.707399 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Openstack-Nova-Api-Version: 2.20 May 23 15:53:03.707399 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Domain-Id: default May 23 15:53:03.707399 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Domain-Name: Default May 23 15:53:03.707399 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Id: 749e4849b23b4e42be64ef0ab0330a0b May 23 15:53:03.707399 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-963625688 May 23 15:53:03.707399 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Role: reader,member May 23 15:53:03.707399 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Roles: reader,member May 23 15:53:03.709228 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/749e4849b23b4e42be64ef0ab0330a0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/749e4849b23b4e42be64ef0ab0330a0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/749e4849b23b4e42be64ef0ab0330a0b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_749e4849b23b4e42be64ef0ab0330a0b", "adminURL": "http://10.222.0.64:8080"}]}] May 23 15:53:03.709228 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant: tempest-AttachVolumeShelveTestJSON-963625688 May 23 15:53:03.709228 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant-Id: 749e4849b23b4e42be64ef0ab0330a0b May 23 15:53:03.709228 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-963625688 May 23 15:53:03.709228 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User: tempest-AttachVolumeShelveTestJSON-963625688-project May 23 15:53:03.709228 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Domain-Id: default May 23 15:53:03.709228 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Domain-Name: Default May 23 15:53:03.709228 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Id: 7a5fc191f3464ffe83d5fde2419cb8b4 May 23 15:53:03.709228 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Name: tempest-AttachVolumeShelveTestJSON-963625688-project May 23 15:53:03.709228 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: method: > May 23 15:53:03.709228 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: exception: Instance 9d9a9391-45aa-4e87-b025-839d2bf5c8a3 could not be found. May 23 15:53:03.709228 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: action_args: {'id': '9d9a9391-45aa-4e87-b025-839d2bf5c8a3'} May 23 15:53:03.710171 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:53:03.710171 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:53:03.710171 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:53:03.710171 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:53:03.710171 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:53:03.710171 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:53:03.710171 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:53:03.710171 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:53:03.710171 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:53:03.710171 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:53:03.710171 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d9a9391-45aa-4e87-b025-839d2bf5c8a3 could not be found. May 23 15:53:03.710171 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:53:03.710171 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:53:03.710171 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:53:03.710171 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:53:03.710171 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:53:03.710171 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:53:03.710171 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:53:03.710171 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:53:03.710171 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:53:03.711704 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:53:03.711704 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 15:53:03.711704 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 15:53:03.711704 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:53:03.711704 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:53:03.711704 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:53:03.711704 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:53:03.711704 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d9a9391-45aa-4e87-b025-839d2bf5c8a3 could not be found. May 23 15:53:03.711704 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:53:03.711704 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:53:03.711704 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:53:03.711704 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:53:03.711704 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:53:03.711704 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:53:03.711704 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:53:03.711704 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:53:03.711704 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d9a9391-45aa-4e87-b025-839d2bf5c8a3 could not be found. May 23 15:53:03.711704 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:53:03.715673 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-dea8d428-32a7-4e06-96f7-5911520cae37 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] Returning 404 to user: Instance 9d9a9391-45aa-4e87-b025-839d2bf5c8a3 could not be found. {{(pid=124934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:53:03.717383 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-dea8d428-32a7-4e06-96f7-5911520cae37 tempest-AttachVolumeShelveTestJSON-963625688 tempest-AttachVolumeShelveTestJSON-963625688-project] 10.222.0.64 "GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3" status: 404 len: 111 microversion: 2.20 time: 0.047551 May 23 15:53:03.722703 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 575/1112] 10.222.0.64 () {60 vars in 1276 bytes} [Mon May 23 15:53:03 2022] GET /compute/v2.1/servers/9d9a9391-45aa-4e87-b025-839d2bf5c8a3 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 23 15:53:04.586174 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 15:53:04.586385 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Mon May 23 15:53:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 15:53:11.429948 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-2cb20f97-3e34-43d9-a81e-4d20463c1e06 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Action: 'create', calling method: .version_select at 0x7fab51eca9d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-338991248", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPgzKh13pic5CC+ZEUIVVMz5o0ke3YyXQBxlO3UFXZn+Ip1HRtSMwZiFMSSqRwvy433tvtIJT0ibLizjEJhXof/NHOrhqP3Rpvc88nYwCsTkT1fl40f8mAFy4fm9R9y5Vw=="}} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:53:11.436077 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=2 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:53:11.446789 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.quota [None req-2cb20f97-3e34-43d9-a81e-4d20463c1e06 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Getting quotas for project 3daaf17c3dac442f82831c7df811f511. Resources: {'key_pairs'} {{(pid=124933) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 15:53:11.451454 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.quota [None req-2cb20f97-3e34-43d9-a81e-4d20463c1e06 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Getting quotas for user 172c28d985cb40409d563fad4fa2ad5c and project 3daaf17c3dac442f82831c7df811f511. Resources: {'key_pairs'} {{(pid=124933) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 15:53:11.567246 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-2cb20f97-3e34-43d9-a81e-4d20463c1e06 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.141067 May 23 15:53:11.567842 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 538/1113] 10.222.0.64 () {60 vars in 1158 bytes} [Mon May 23 15:53:11 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:53:11.662490 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-69c0e853-6488-4dc3-8d26-1cac0093c7a3 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-532457983", "imageRef": "35529641-e893-4add-85ba-41ad794a1a32", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-338991248", "networks": [{"uuid": "78e8e9b6-c2a4-4052-9c22-01fa79bc5a77"}]}} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:53:11.670794 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:53:11.723848 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.network.neutron [None req-69c0e853-6488-4dc3-8d26-1cac0093c7a3 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] validate_networks() for [('78e8e9b6-c2a4-4052-9c22-01fa79bc5a77', None, None, None, None, None)] {{(pid=124934) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 15:53:12.226111 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.virt.hardware [None req-69c0e853-6488-4dc3-8d26-1cac0093c7a3 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Flavor limits 0:0:0 {{(pid=124934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 15:53:12.226577 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.virt.hardware [None req-69c0e853-6488-4dc3-8d26-1cac0093c7a3 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Image limits 0:0:0 {{(pid=124934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 15:53:12.227066 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.virt.hardware [None req-69c0e853-6488-4dc3-8d26-1cac0093c7a3 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Flavor pref 0:0:0 {{(pid=124934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 15:53:12.227849 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.virt.hardware [None req-69c0e853-6488-4dc3-8d26-1cac0093c7a3 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Image pref 0:0:0 {{(pid=124934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 15:53:12.228279 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.virt.hardware [None req-69c0e853-6488-4dc3-8d26-1cac0093c7a3 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124934) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 15:53:12.237422 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-69c0e853-6488-4dc3-8d26-1cac0093c7a3 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:53:12.237883 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-69c0e853-6488-4dc3-8d26-1cac0093c7a3 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:53:12.238722 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-69c0e853-6488-4dc3-8d26-1cac0093c7a3 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:53:12.239172 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-69c0e853-6488-4dc3-8d26-1cac0093c7a3 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:53:12.246542 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:53:12.257098 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.quota [None req-69c0e853-6488-4dc3-8d26-1cac0093c7a3 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Getting quotas for project 3daaf17c3dac442f82831c7df811f511. Resources: {'ram', 'instances', 'cores'} {{(pid=124934) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 15:53:12.262048 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.quota [None req-69c0e853-6488-4dc3-8d26-1cac0093c7a3 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Getting quotas for user 172c28d985cb40409d563fad4fa2ad5c and project 3daaf17c3dac442f82831c7df811f511. Resources: {'ram', 'instances', 'cores'} {{(pid=124934) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 15:53:12.273644 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-69c0e853-6488-4dc3-8d26-1cac0093c7a3 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Going to run 1 instances... {{(pid=124934) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 15:53:12.275984 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-69c0e853-6488-4dc3-8d26-1cac0093c7a3 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] [instance: 5010ba7c-c06f-42fc-9868-3782ff2350e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='35529641-e893-4add-85ba-41ad794a1a32',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124934) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 15:53:12.374508 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-69c0e853-6488-4dc3-8d26-1cac0093c7a3 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.716010 May 23 15:53:12.376618 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 576/1114] 10.222.0.64 () {60 vars in 1146 bytes} [Mon May 23 15:53:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 15:53:12.386452 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-6266df33-f409-4142-b32c-cef910ab3457 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:53:12.387157 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-6266df33-f409-4142-b32c-cef910ab3457 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] [instance: 5010ba7c-c06f-42fc-9868-3782ff2350e6] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:53:12.446717 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-6266df33-f409-4142-b32c-cef910ab3457 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172c28d985cb40409d563fad4fa2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3daaf17c3dac442f82831c7df811f511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:53:12.452272 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-6266df33-f409-4142-b32c-cef910ab3457 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] 10.222.0.64 "GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6" status: 200 len: 1257 microversion: 2.1 time: 0.070989 May 23 15:53:12.453265 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 539/1115] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:53:12 2022] GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6 => generated 1257 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:53:13.470732 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-3e5bee64-a4f2-4e6c-b434-fed8a8853e30 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:53:13.471366 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-3e5bee64-a4f2-4e6c-b434-fed8a8853e30 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] [instance: 5010ba7c-c06f-42fc-9868-3782ff2350e6] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:53:13.523779 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-3e5bee64-a4f2-4e6c-b434-fed8a8853e30 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172c28d985cb40409d563fad4fa2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3daaf17c3dac442f82831c7df811f511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:53:13.531825 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-3e5bee64-a4f2-4e6c-b434-fed8a8853e30 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] 10.222.0.64 "GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6" status: 200 len: 1257 microversion: 2.1 time: 0.066165 May 23 15:53:13.532377 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 577/1116] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:53:13 2022] GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6 => generated 1257 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:53:14.548421 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-075cb2e3-ce7f-48eb-af5b-75678852cdbb tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:53:14.549048 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-075cb2e3-ce7f-48eb-af5b-75678852cdbb tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] [instance: 5010ba7c-c06f-42fc-9868-3782ff2350e6] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:53:14.551609 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:53:14.556690 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-075cb2e3-ce7f-48eb-af5b-75678852cdbb tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:53:14.557883 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-075cb2e3-ce7f-48eb-af5b-75678852cdbb tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:53:14.558737 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-075cb2e3-ce7f-48eb-af5b-75678852cdbb tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:53:14.559263 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-075cb2e3-ce7f-48eb-af5b-75678852cdbb tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:53:14.623821 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-075cb2e3-ce7f-48eb-af5b-75678852cdbb tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172c28d985cb40409d563fad4fa2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3daaf17c3dac442f82831c7df811f511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:53:14.631370 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-075cb2e3-ce7f-48eb-af5b-75678852cdbb tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] 10.222.0.64 "GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6" status: 200 len: 1309 microversion: 2.1 time: 0.086865 May 23 15:53:14.631923 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 540/1117] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:53:14 2022] GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6 => generated 1309 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:53:15.647600 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-c44c6410-71de-4ffb-9e98-11d742d48363 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:53:15.648184 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-c44c6410-71de-4ffb-9e98-11d742d48363 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] [instance: 5010ba7c-c06f-42fc-9868-3782ff2350e6] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:53:15.655447 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-c44c6410-71de-4ffb-9e98-11d742d48363 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:53:15.655907 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-c44c6410-71de-4ffb-9e98-11d742d48363 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:53:15.656685 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-c44c6410-71de-4ffb-9e98-11d742d48363 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:53:15.657451 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-c44c6410-71de-4ffb-9e98-11d742d48363 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:53:15.903815 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-c44c6410-71de-4ffb-9e98-11d742d48363 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172c28d985cb40409d563fad4fa2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3daaf17c3dac442f82831c7df811f511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:53:15.919391 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-c44c6410-71de-4ffb-9e98-11d742d48363 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] 10.222.0.64 "GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6" status: 200 len: 1357 microversion: 2.1 time: 0.275363 May 23 15:53:15.920124 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 578/1118] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:53:15 2022] GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6 => generated 1357 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:53:16.937931 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-f504e76a-5724-4233-b268-313dc8d2eced tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:53:16.939289 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-f504e76a-5724-4233-b268-313dc8d2eced tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] [instance: 5010ba7c-c06f-42fc-9868-3782ff2350e6] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:53:16.959109 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-f504e76a-5724-4233-b268-313dc8d2eced tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:53:16.965879 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-f504e76a-5724-4233-b268-313dc8d2eced tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:53:16.967072 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-f504e76a-5724-4233-b268-313dc8d2eced tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:53:16.967664 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-f504e76a-5724-4233-b268-313dc8d2eced tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:53:17.008302 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 15:53:17.011691 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Mon May 23 15:53:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6 (ip 10.222.0.64) !!! May 23 15:53:17.149897 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [req-30e9e4e5-01d7-4935-bd54-920de8959280 req-4b23cb29-467f-4a16-8bec-d7976ce9c337 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5010ba7c-c06f-42fc-9868-3782ff2350e6", "tag": "76ad3e47-7e7d-4fde-9328-3a30596e0087"}]} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:53:17.161500 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-30e9e4e5-01d7-4935-bd54-920de8959280 req-4b23cb29-467f-4a16-8bec-d7976ce9c337 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:53:17.165187 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-30e9e4e5-01d7-4935-bd54-920de8959280 req-4b23cb29-467f-4a16-8bec-d7976ce9c337 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:53:17.177099 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.compute.server_external_events [req-30e9e4e5-01d7-4935-bd54-920de8959280 req-4b23cb29-467f-4a16-8bec-d7976ce9c337 service nova] Creating event network-changed:76ad3e47-7e7d-4fde-9328-3a30596e0087 for instance 5010ba7c-c06f-42fc-9868-3782ff2350e6 on hv-cinder-84067 May 23 15:53:17.196711 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [req-30e9e4e5-01d7-4935-bd54-920de8959280 req-4b23cb29-467f-4a16-8bec-d7976ce9c337 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053344 May 23 15:53:17.198539 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 579/1119] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:53:17.213993 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-f504e76a-5724-4233-b268-313dc8d2eced tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172c28d985cb40409d563fad4fa2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3daaf17c3dac442f82831c7df811f511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:53:17.225988 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-f504e76a-5724-4233-b268-313dc8d2eced tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] 10.222.0.64 "GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6" status: 200 len: 1357 microversion: 2.1 time: 0.293717 May 23 15:53:17.227232 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 541/1120] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:53:16 2022] GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6 => generated 1357 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:53:18.245359 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-dce15440-4efa-46c8-abc1-2970848c8002 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:53:18.245975 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-dce15440-4efa-46c8-abc1-2970848c8002 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] [instance: 5010ba7c-c06f-42fc-9868-3782ff2350e6] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:53:18.252951 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-dce15440-4efa-46c8-abc1-2970848c8002 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:53:18.253427 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-dce15440-4efa-46c8-abc1-2970848c8002 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:53:18.254201 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-dce15440-4efa-46c8-abc1-2970848c8002 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:53:18.254637 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-dce15440-4efa-46c8-abc1-2970848c8002 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:53:18.395412 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-dce15440-4efa-46c8-abc1-2970848c8002 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172c28d985cb40409d563fad4fa2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3daaf17c3dac442f82831c7df811f511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:53:18.402998 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-dce15440-4efa-46c8-abc1-2970848c8002 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] 10.222.0.64 "GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6" status: 200 len: 1357 microversion: 2.1 time: 0.162838 May 23 15:53:18.403569 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 580/1121] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:53:18 2022] GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6 => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:53:19.419535 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-28f79fe3-36c2-4169-8ba9-9c30599e92db tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:53:19.420163 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-28f79fe3-36c2-4169-8ba9-9c30599e92db tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] [instance: 5010ba7c-c06f-42fc-9868-3782ff2350e6] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:53:19.427601 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-28f79fe3-36c2-4169-8ba9-9c30599e92db tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:53:19.428220 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-28f79fe3-36c2-4169-8ba9-9c30599e92db tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:53:19.429389 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-28f79fe3-36c2-4169-8ba9-9c30599e92db tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:53:19.429854 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-28f79fe3-36c2-4169-8ba9-9c30599e92db tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:53:19.580310 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-28f79fe3-36c2-4169-8ba9-9c30599e92db tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172c28d985cb40409d563fad4fa2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3daaf17c3dac442f82831c7df811f511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:53:19.587978 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-28f79fe3-36c2-4169-8ba9-9c30599e92db tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] 10.222.0.64 "GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6" status: 200 len: 1357 microversion: 2.1 time: 0.172233 May 23 15:53:19.588673 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 542/1122] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:53:19 2022] GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6 => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:53:20.605411 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-c28da743-80ac-45e1-8470-ac16e8746795 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:53:20.606024 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-c28da743-80ac-45e1-8470-ac16e8746795 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] [instance: 5010ba7c-c06f-42fc-9868-3782ff2350e6] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:53:20.612839 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-c28da743-80ac-45e1-8470-ac16e8746795 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:53:20.613322 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-c28da743-80ac-45e1-8470-ac16e8746795 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:53:20.614189 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-c28da743-80ac-45e1-8470-ac16e8746795 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:53:20.614830 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-c28da743-80ac-45e1-8470-ac16e8746795 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:53:20.758720 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-c28da743-80ac-45e1-8470-ac16e8746795 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172c28d985cb40409d563fad4fa2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3daaf17c3dac442f82831c7df811f511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:53:20.771652 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-c28da743-80ac-45e1-8470-ac16e8746795 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] 10.222.0.64 "GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6" status: 200 len: 1357 microversion: 2.1 time: 0.170720 May 23 15:53:20.772691 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 581/1123] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:53:20 2022] GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6 => generated 1357 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:53:21.801733 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-4b1ad03a-d19d-4277-8583-63e4f4d41b76 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:53:21.802832 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-4b1ad03a-d19d-4277-8583-63e4f4d41b76 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] [instance: 5010ba7c-c06f-42fc-9868-3782ff2350e6] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:53:21.818849 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-4b1ad03a-d19d-4277-8583-63e4f4d41b76 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:53:21.819305 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-4b1ad03a-d19d-4277-8583-63e4f4d41b76 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:53:21.820193 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-4b1ad03a-d19d-4277-8583-63e4f4d41b76 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:53:21.820634 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-4b1ad03a-d19d-4277-8583-63e4f4d41b76 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:53:22.030464 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-4b1ad03a-d19d-4277-8583-63e4f4d41b76 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172c28d985cb40409d563fad4fa2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3daaf17c3dac442f82831c7df811f511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:53:22.047247 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-4b1ad03a-d19d-4277-8583-63e4f4d41b76 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] 10.222.0.64 "GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6" status: 200 len: 1357 microversion: 2.1 time: 0.261325 May 23 15:53:22.048885 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 543/1124] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:53:21 2022] GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6 => generated 1357 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:53:23.067288 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-53dd2bb1-688c-46b2-bd5a-e575b719bed0 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:53:23.068115 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-53dd2bb1-688c-46b2-bd5a-e575b719bed0 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] [instance: 5010ba7c-c06f-42fc-9868-3782ff2350e6] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:53:23.070788 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_cell0:SELECT=2 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:53:23.077025 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-53dd2bb1-688c-46b2-bd5a-e575b719bed0 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:53:23.077520 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-53dd2bb1-688c-46b2-bd5a-e575b719bed0 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:53:23.078319 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-53dd2bb1-688c-46b2-bd5a-e575b719bed0 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:53:23.078760 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-53dd2bb1-688c-46b2-bd5a-e575b719bed0 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:53:23.250332 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-53dd2bb1-688c-46b2-bd5a-e575b719bed0 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172c28d985cb40409d563fad4fa2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3daaf17c3dac442f82831c7df811f511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:53:23.270460 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-53dd2bb1-688c-46b2-bd5a-e575b719bed0 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] 10.222.0.64 "GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6" status: 200 len: 1357 microversion: 2.1 time: 0.196567 May 23 15:53:23.270460 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 582/1125] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:53:23 2022] GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6 => generated 1357 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:53:24.286613 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-6657e14d-e5a8-40ca-93f7-3d46614d44d9 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:53:24.287240 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-6657e14d-e5a8-40ca-93f7-3d46614d44d9 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] [instance: 5010ba7c-c06f-42fc-9868-3782ff2350e6] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:53:24.289050 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_cell0:SELECT=6 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:53:24.294811 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-6657e14d-e5a8-40ca-93f7-3d46614d44d9 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:53:24.295257 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-6657e14d-e5a8-40ca-93f7-3d46614d44d9 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:53:24.296019 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-6657e14d-e5a8-40ca-93f7-3d46614d44d9 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:53:24.296452 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-6657e14d-e5a8-40ca-93f7-3d46614d44d9 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:53:24.513273 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-6657e14d-e5a8-40ca-93f7-3d46614d44d9 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172c28d985cb40409d563fad4fa2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3daaf17c3dac442f82831c7df811f511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:53:24.521009 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-6657e14d-e5a8-40ca-93f7-3d46614d44d9 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] 10.222.0.64 "GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6" status: 200 len: 1357 microversion: 2.1 time: 0.238298 May 23 15:53:24.521610 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 544/1126] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:53:24 2022] GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6 => generated 1357 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:53:25.538330 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-131bfde1-3858-4ed3-8255-1aeeb1ab63f4 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:53:25.538951 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-131bfde1-3858-4ed3-8255-1aeeb1ab63f4 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] [instance: 5010ba7c-c06f-42fc-9868-3782ff2350e6] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:53:25.540851 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_cell0:SELECT=8 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:53:25.546330 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-131bfde1-3858-4ed3-8255-1aeeb1ab63f4 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:53:25.547028 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-131bfde1-3858-4ed3-8255-1aeeb1ab63f4 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:53:25.547546 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-131bfde1-3858-4ed3-8255-1aeeb1ab63f4 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:53:25.548023 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-131bfde1-3858-4ed3-8255-1aeeb1ab63f4 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:53:25.678017 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-131bfde1-3858-4ed3-8255-1aeeb1ab63f4 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172c28d985cb40409d563fad4fa2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3daaf17c3dac442f82831c7df811f511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:53:25.686795 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-131bfde1-3858-4ed3-8255-1aeeb1ab63f4 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] 10.222.0.64 "GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6" status: 200 len: 1357 microversion: 2.1 time: 0.152270 May 23 15:53:25.687715 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 583/1127] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:53:25 2022] GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:53:26.709014 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-943a5fb2-430a-44a7-ad88-69362c3378b9 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:53:26.710384 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-943a5fb2-430a-44a7-ad88-69362c3378b9 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] [instance: 5010ba7c-c06f-42fc-9868-3782ff2350e6] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:53:26.718178 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-943a5fb2-430a-44a7-ad88-69362c3378b9 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:53:26.718637 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-943a5fb2-430a-44a7-ad88-69362c3378b9 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:53:26.719417 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-943a5fb2-430a-44a7-ad88-69362c3378b9 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:53:26.719868 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-943a5fb2-430a-44a7-ad88-69362c3378b9 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:53:26.856148 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-943a5fb2-430a-44a7-ad88-69362c3378b9 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172c28d985cb40409d563fad4fa2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3daaf17c3dac442f82831c7df811f511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:53:26.863782 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-943a5fb2-430a-44a7-ad88-69362c3378b9 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] 10.222.0.64 "GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6" status: 200 len: 1357 microversion: 2.1 time: 0.159152 May 23 15:53:26.864341 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 545/1128] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:53:26 2022] GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6 => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:53:27.881121 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-fbc12efe-e4f7-47bb-befc-579bce6c0f97 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:53:27.881748 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-fbc12efe-e4f7-47bb-befc-579bce6c0f97 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] [instance: 5010ba7c-c06f-42fc-9868-3782ff2350e6] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:53:27.888818 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-fbc12efe-e4f7-47bb-befc-579bce6c0f97 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:53:27.889306 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-fbc12efe-e4f7-47bb-befc-579bce6c0f97 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:53:27.890085 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-fbc12efe-e4f7-47bb-befc-579bce6c0f97 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:53:27.890531 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-fbc12efe-e4f7-47bb-befc-579bce6c0f97 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:53:28.053134 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-fbc12efe-e4f7-47bb-befc-579bce6c0f97 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172c28d985cb40409d563fad4fa2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3daaf17c3dac442f82831c7df811f511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:53:28.061238 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-fbc12efe-e4f7-47bb-befc-579bce6c0f97 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] 10.222.0.64 "GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6" status: 200 len: 1357 microversion: 2.1 time: 0.184055 May 23 15:53:28.061792 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 584/1129] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:53:27 2022] GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6 => generated 1357 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:53:28.954413 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [req-c755aff6-55c5-40c4-9621-ce752e6a3141 req-027496b2-6081-484a-9abf-994bba3d0013 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5010ba7c-c06f-42fc-9868-3782ff2350e6", "name": "network-vif-plugged", "status": "completed", "tag": "76ad3e47-7e7d-4fde-9328-3a30596e0087"}]} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:53:28.962575 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-c755aff6-55c5-40c4-9621-ce752e6a3141 req-027496b2-6081-484a-9abf-994bba3d0013 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:53:28.963023 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-c755aff6-55c5-40c4-9621-ce752e6a3141 req-027496b2-6081-484a-9abf-994bba3d0013 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:53:28.975155 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.compute.server_external_events [req-c755aff6-55c5-40c4-9621-ce752e6a3141 req-027496b2-6081-484a-9abf-994bba3d0013 service nova] Creating event network-vif-plugged:76ad3e47-7e7d-4fde-9328-3a30596e0087 for instance 5010ba7c-c06f-42fc-9868-3782ff2350e6 on hv-cinder-84067 May 23 15:53:28.980414 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [req-c755aff6-55c5-40c4-9621-ce752e6a3141 req-027496b2-6081-484a-9abf-994bba3d0013 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150467 May 23 15:53:28.981000 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 546/1130] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:53:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:53:29.078904 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-3c1ee056-756d-4f96-9cc3-bd0dca43e4d1 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:53:29.086204 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-3c1ee056-756d-4f96-9cc3-bd0dca43e4d1 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] [instance: 5010ba7c-c06f-42fc-9868-3782ff2350e6] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:53:29.086204 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3c1ee056-756d-4f96-9cc3-bd0dca43e4d1 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:53:29.086204 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3c1ee056-756d-4f96-9cc3-bd0dca43e4d1 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:53:29.086896 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3c1ee056-756d-4f96-9cc3-bd0dca43e4d1 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:53:29.087348 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3c1ee056-756d-4f96-9cc3-bd0dca43e4d1 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:53:29.220375 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-3c1ee056-756d-4f96-9cc3-bd0dca43e4d1 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172c28d985cb40409d563fad4fa2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3daaf17c3dac442f82831c7df811f511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:53:29.227812 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-3c1ee056-756d-4f96-9cc3-bd0dca43e4d1 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] 10.222.0.64 "GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6" status: 200 len: 1357 microversion: 2.1 time: 0.153526 May 23 15:53:29.228361 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 585/1131] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:53:29 2022] GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:53:30.250706 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-a79280ab-adba-42c1-bd5d-fe0fd7f1ce3b tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:53:30.251829 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-a79280ab-adba-42c1-bd5d-fe0fd7f1ce3b tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] [instance: 5010ba7c-c06f-42fc-9868-3782ff2350e6] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:53:30.258123 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a79280ab-adba-42c1-bd5d-fe0fd7f1ce3b tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:53:30.258571 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a79280ab-adba-42c1-bd5d-fe0fd7f1ce3b tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:53:30.259337 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a79280ab-adba-42c1-bd5d-fe0fd7f1ce3b tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:53:30.259772 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a79280ab-adba-42c1-bd5d-fe0fd7f1ce3b tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:53:30.396081 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-a79280ab-adba-42c1-bd5d-fe0fd7f1ce3b tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172c28d985cb40409d563fad4fa2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3daaf17c3dac442f82831c7df811f511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:53:30.404588 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-a79280ab-adba-42c1-bd5d-fe0fd7f1ce3b tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] 10.222.0.64 "GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6" status: 200 len: 1357 microversion: 2.1 time: 0.161813 May 23 15:53:30.410450 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 547/1132] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:53:30 2022] GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6 => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:53:31.422164 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-e1ec3601-f8d4-4771-9462-63f1fd78dcc6 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:53:31.422970 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-e1ec3601-f8d4-4771-9462-63f1fd78dcc6 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] [instance: 5010ba7c-c06f-42fc-9868-3782ff2350e6] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:53:31.429939 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e1ec3601-f8d4-4771-9462-63f1fd78dcc6 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:53:31.430395 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e1ec3601-f8d4-4771-9462-63f1fd78dcc6 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:53:31.431180 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e1ec3601-f8d4-4771-9462-63f1fd78dcc6 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:53:31.431623 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e1ec3601-f8d4-4771-9462-63f1fd78dcc6 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:53:31.561326 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-e1ec3601-f8d4-4771-9462-63f1fd78dcc6 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172c28d985cb40409d563fad4fa2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3daaf17c3dac442f82831c7df811f511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:53:31.569251 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-e1ec3601-f8d4-4771-9462-63f1fd78dcc6 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] 10.222.0.64 "GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6" status: 200 len: 1546 microversion: 2.1 time: 0.151777 May 23 15:53:31.569855 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 586/1133] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:53:31 2022] GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6 => generated 1546 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:53:31.585970 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-679272dd-ed45-453f-a32c-fd84373ac5bf tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:53:31.588475 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-679272dd-ed45-453f-a32c-fd84373ac5bf tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] [instance: 5010ba7c-c06f-42fc-9868-3782ff2350e6] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:53:31.593715 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-679272dd-ed45-453f-a32c-fd84373ac5bf tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:53:31.594171 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-679272dd-ed45-453f-a32c-fd84373ac5bf tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:53:31.594943 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-679272dd-ed45-453f-a32c-fd84373ac5bf tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:53:31.595387 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-679272dd-ed45-453f-a32c-fd84373ac5bf tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:53:31.731019 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-679272dd-ed45-453f-a32c-fd84373ac5bf tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172c28d985cb40409d563fad4fa2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3daaf17c3dac442f82831c7df811f511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:53:31.739222 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-679272dd-ed45-453f-a32c-fd84373ac5bf tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] 10.222.0.64 "GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6" status: 200 len: 1546 microversion: 2.1 time: 0.157278 May 23 15:53:31.740905 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 548/1134] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:53:31 2022] GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6 => generated 1546 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:53:31.754759 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-0394018f-4d5f-4088-b538-367f177bcda9 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:53:31.758297 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-0394018f-4d5f-4088-b538-367f177bcda9 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '172c28d985cb40409d563fad4fa2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3daaf17c3dac442f82831c7df811f511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:53:31.759288 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-0394018f-4d5f-4088-b538-367f177bcda9 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Searching by: {'deleted': False, 'project_id': '3daaf17c3dac442f82831c7df811f511'} {{(pid=124934) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 23 15:53:31.766784 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0394018f-4d5f-4088-b538-367f177bcda9 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:53:31.769551 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0394018f-4d5f-4088-b538-367f177bcda9 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:53:31.769551 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0394018f-4d5f-4088-b538-367f177bcda9 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:53:31.769551 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-0394018f-4d5f-4088-b538-367f177bcda9 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:53:31.858013 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.multi_cell_list [None req-0394018f-4d5f-4088-b538-367f177bcda9 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124934) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 23 15:53:31.952379 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-0394018f-4d5f-4088-b538-367f177bcda9 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] 10.222.0.64 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.201252 May 23 15:53:31.952900 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 587/1135] 10.222.0.64 () {58 vars in 1124 bytes} [Mon May 23 15:53:31 2022] GET /compute/v2.1/servers => generated 342 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:53:31.963193 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-3c67b70e-7f2b-40e3-a019-c49d10775a90 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:53:31.972445 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-3c67b70e-7f2b-40e3-a019-c49d10775a90 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] [instance: 5010ba7c-c06f-42fc-9868-3782ff2350e6] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:53:31.972445 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-3c67b70e-7f2b-40e3-a019-c49d10775a90 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:53:31.972445 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-3c67b70e-7f2b-40e3-a019-c49d10775a90 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:53:31.972445 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-3c67b70e-7f2b-40e3-a019-c49d10775a90 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:53:31.972859 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-3c67b70e-7f2b-40e3-a019-c49d10775a90 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:53:32.102831 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-3c67b70e-7f2b-40e3-a019-c49d10775a90 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172c28d985cb40409d563fad4fa2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3daaf17c3dac442f82831c7df811f511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:53:32.115534 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-3c67b70e-7f2b-40e3-a019-c49d10775a90 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] 10.222.0.64 "GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6" status: 200 len: 1546 microversion: 2.1 time: 0.156171 May 23 15:53:32.116123 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 549/1136] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:53:31 2022] GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6 => generated 1546 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:53:34.067915 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-12eaf57c-4fd8-401f-bbc3-cd77bdc8e61f tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "32d8da76-2d3a-43f7-8fa8-eae488455364"}} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:53:34.068981 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-12eaf57c-4fd8-401f-bbc3-cd77bdc8e61f tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] [instance: 5010ba7c-c06f-42fc-9868-3782ff2350e6] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:53:34.074804 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-12eaf57c-4fd8-401f-bbc3-cd77bdc8e61f tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:53:34.075796 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-12eaf57c-4fd8-401f-bbc3-cd77bdc8e61f tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:53:34.077299 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-12eaf57c-4fd8-401f-bbc3-cd77bdc8e61f tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:53:34.077745 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-12eaf57c-4fd8-401f-bbc3-cd77bdc8e61f tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:53:34.925574 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-12eaf57c-4fd8-401f-bbc3-cd77bdc8e61f tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] 10.222.0.64 "POST /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.861321 May 23 15:53:34.926221 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 588/1137] 10.222.0.64 () {60 vars in 1322 bytes} [Mon May 23 15:53:34 2022] POST /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6/os-volume_attachments => generated 194 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:53:44.592726 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-38f68c77-c601-40ba-94ab-4809a78d18bb tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:53:44.592726 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-38f68c77-c601-40ba-94ab-4809a78d18bb tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] [instance: 5010ba7c-c06f-42fc-9868-3782ff2350e6] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:53:44.592726 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:53:44.592726 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_cell1:SELECT=56 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:53:44.592726 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-38f68c77-c601-40ba-94ab-4809a78d18bb tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:53:44.593861 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-38f68c77-c601-40ba-94ab-4809a78d18bb tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:53:44.593861 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-38f68c77-c601-40ba-94ab-4809a78d18bb tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:53:44.594144 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-38f68c77-c601-40ba-94ab-4809a78d18bb tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:53:44.979979 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-38f68c77-c601-40ba-94ab-4809a78d18bb tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172c28d985cb40409d563fad4fa2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3daaf17c3dac442f82831c7df811f511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:53:44.989171 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-38f68c77-c601-40ba-94ab-4809a78d18bb tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] 10.222.0.64 "GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6" status: 200 len: 1592 microversion: 2.1 time: 0.409486 May 23 15:53:44.997175 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 550/1138] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:53:44 2022] GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6 => generated 1592 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:53:47.464192 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_cell0:SELECT=2 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:53:47.464956 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:53:47.465779 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:53:47.470028 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [req-8e5e20c6-f235-45a7-beec-3b0c63ee744d req-b586b40e-7bb6-43c1-ae2d-97cba0d0095e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5010ba7c-c06f-42fc-9868-3782ff2350e6", "tag": "76ad3e47-7e7d-4fde-9328-3a30596e0087"}]} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:53:47.479669 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-8e5e20c6-f235-45a7-beec-3b0c63ee744d req-b586b40e-7bb6-43c1-ae2d-97cba0d0095e service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:53:47.480125 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-8e5e20c6-f235-45a7-beec-3b0c63ee744d req-b586b40e-7bb6-43c1-ae2d-97cba0d0095e service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:53:47.491878 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.compute.server_external_events [req-8e5e20c6-f235-45a7-beec-3b0c63ee744d req-b586b40e-7bb6-43c1-ae2d-97cba0d0095e service nova] Creating event network-changed:76ad3e47-7e7d-4fde-9328-3a30596e0087 for instance 5010ba7c-c06f-42fc-9868-3782ff2350e6 on hv-cinder-84067 May 23 15:53:47.497528 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [req-8e5e20c6-f235-45a7-beec-3b0c63ee744d req-b586b40e-7bb6-43c1-ae2d-97cba0d0095e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034707 May 23 15:53:47.498734 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 589/1139] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:53:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:53:50.554788 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-fd74ad54-ad94-4f07-ac8d-ee4cdfc81e18 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1984262076"}} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:53:50.555383 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-fd74ad54-ad94-4f07-ac8d-ee4cdfc81e18 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] [instance: 5010ba7c-c06f-42fc-9868-3782ff2350e6] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:53:50.562856 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-fd74ad54-ad94-4f07-ac8d-ee4cdfc81e18 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:53:50.563420 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-fd74ad54-ad94-4f07-ac8d-ee4cdfc81e18 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:53:50.564344 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-fd74ad54-ad94-4f07-ac8d-ee4cdfc81e18 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:53:50.564876 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-fd74ad54-ad94-4f07-ac8d-ee4cdfc81e18 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:53:50.692523 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.network.security_group_api [None req-fd74ad54-ad94-4f07-ac8d-ee4cdfc81e18 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Adding security group 27d63fb7-8e79-464e-a1a6-5f1640e478ab to port 76ad3e47-7e7d-4fde-9328-3a30596e0087 May 23 15:53:51.166767 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-fd74ad54-ad94-4f07-ac8d-ee4cdfc81e18 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] 10.222.0.64 "POST /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6/action" status: 202 len: 0 microversion: 2.1 time: 0.616233 May 23 15:53:51.168488 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 551/1140] 10.222.0.64 () {60 vars in 1277 bytes} [Mon May 23 15:53:50 2022] POST /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6/action => generated 0 bytes in 619 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 15:53:51.177312 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-48f0fed0-503e-46b1-a54c-9f1fde8df2fd tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:53:51.178250 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-48f0fed0-503e-46b1-a54c-9f1fde8df2fd tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] [instance: 5010ba7c-c06f-42fc-9868-3782ff2350e6] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:53:51.185645 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [req-366019d3-e4b4-43e5-b8d9-a7050cd4ce50 req-14e95ed5-a5e1-41e0-a28c-a6690e58127a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5010ba7c-c06f-42fc-9868-3782ff2350e6", "tag": "76ad3e47-7e7d-4fde-9328-3a30596e0087"}]} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:53:51.187088 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-48f0fed0-503e-46b1-a54c-9f1fde8df2fd tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:53:51.187896 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-48f0fed0-503e-46b1-a54c-9f1fde8df2fd tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:53:51.189196 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-48f0fed0-503e-46b1-a54c-9f1fde8df2fd tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:53:51.189866 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-48f0fed0-503e-46b1-a54c-9f1fde8df2fd tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:53:51.208060 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-366019d3-e4b4-43e5-b8d9-a7050cd4ce50 req-14e95ed5-a5e1-41e0-a28c-a6690e58127a service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:53:51.208060 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-366019d3-e4b4-43e5-b8d9-a7050cd4ce50 req-14e95ed5-a5e1-41e0-a28c-a6690e58127a service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:53:51.233661 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.compute.server_external_events [req-366019d3-e4b4-43e5-b8d9-a7050cd4ce50 req-14e95ed5-a5e1-41e0-a28c-a6690e58127a service nova] Creating event network-changed:76ad3e47-7e7d-4fde-9328-3a30596e0087 for instance 5010ba7c-c06f-42fc-9868-3782ff2350e6 on hv-cinder-84067 May 23 15:53:51.239188 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [req-366019d3-e4b4-43e5-b8d9-a7050cd4ce50 req-14e95ed5-a5e1-41e0-a28c-a6690e58127a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065833 May 23 15:53:51.243787 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 590/1141] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:53:51.483077 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-48f0fed0-503e-46b1-a54c-9f1fde8df2fd tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172c28d985cb40409d563fad4fa2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3daaf17c3dac442f82831c7df811f511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:53:51.492104 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-48f0fed0-503e-46b1-a54c-9f1fde8df2fd tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] 10.222.0.64 "GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6" status: 200 len: 1758 microversion: 2.1 time: 0.318979 May 23 15:53:51.505637 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 552/1142] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:53:51 2022] GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6 => generated 1758 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:54:05.440227 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-f1b08d8e-2fad-4399-851a-541153e76e20 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:54:05.441295 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-f1b08d8e-2fad-4399-851a-541153e76e20 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] [instance: 5010ba7c-c06f-42fc-9868-3782ff2350e6] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:54:05.447696 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-f1b08d8e-2fad-4399-851a-541153e76e20 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:54:05.448154 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-f1b08d8e-2fad-4399-851a-541153e76e20 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:54:05.448926 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-f1b08d8e-2fad-4399-851a-541153e76e20 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:54:05.449395 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-f1b08d8e-2fad-4399-851a-541153e76e20 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:54:05.676801 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-f1b08d8e-2fad-4399-851a-541153e76e20 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] 10.222.0.64 "POST /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6/action" status: 202 len: 0 microversion: 2.1 time: 0.241869 May 23 15:54:05.677471 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 591/1143] 10.222.0.64 () {60 vars in 1277 bytes} [Mon May 23 15:54:05 2022] POST /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 23 15:54:05.685998 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-f8250eeb-1f77-443c-976a-7f3c0b3cfcc0 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:54:05.686532 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-f8250eeb-1f77-443c-976a-7f3c0b3cfcc0 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] [instance: 5010ba7c-c06f-42fc-9868-3782ff2350e6] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:54:05.688690 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_api:SELECT=6 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:54:05.690609 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_cell1:SELECT=16 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:54:05.695398 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-f8250eeb-1f77-443c-976a-7f3c0b3cfcc0 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:54:05.695853 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-f8250eeb-1f77-443c-976a-7f3c0b3cfcc0 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:54:05.698256 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-f8250eeb-1f77-443c-976a-7f3c0b3cfcc0 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:54:05.698256 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-f8250eeb-1f77-443c-976a-7f3c0b3cfcc0 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:54:05.871860 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-f8250eeb-1f77-443c-976a-7f3c0b3cfcc0 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172c28d985cb40409d563fad4fa2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3daaf17c3dac442f82831c7df811f511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:54:05.878493 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-f8250eeb-1f77-443c-976a-7f3c0b3cfcc0 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] 10.222.0.64 "GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6" status: 200 len: 1750 microversion: 2.1 time: 0.196654 May 23 15:54:05.879075 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 553/1144] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:54:05 2022] GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6 => generated 1750 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:54:06.949132 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-bc913a4e-095f-43e7-8180-60b6772bb06a tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:54:06.949936 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-bc913a4e-095f-43e7-8180-60b6772bb06a tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] [instance: 5010ba7c-c06f-42fc-9868-3782ff2350e6] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:54:06.956677 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-bc913a4e-095f-43e7-8180-60b6772bb06a tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:54:06.959283 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-bc913a4e-095f-43e7-8180-60b6772bb06a tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:54:06.959283 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-bc913a4e-095f-43e7-8180-60b6772bb06a tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:54:06.959283 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-bc913a4e-095f-43e7-8180-60b6772bb06a tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:54:07.104801 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-bc913a4e-095f-43e7-8180-60b6772bb06a tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172c28d985cb40409d563fad4fa2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3daaf17c3dac442f82831c7df811f511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:54:07.113255 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-bc913a4e-095f-43e7-8180-60b6772bb06a tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] 10.222.0.64 "GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6" status: 200 len: 1755 microversion: 2.1 time: 0.169044 May 23 15:54:07.113823 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 592/1145] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:54:06 2022] GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:54:08.131128 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-57910d41-d8ae-4ce2-b2cc-becfa85b553c tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:54:08.131741 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-57910d41-d8ae-4ce2-b2cc-becfa85b553c tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] [instance: 5010ba7c-c06f-42fc-9868-3782ff2350e6] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:54:08.138598 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-57910d41-d8ae-4ce2-b2cc-becfa85b553c tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:54:08.139055 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-57910d41-d8ae-4ce2-b2cc-becfa85b553c tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:54:08.139813 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-57910d41-d8ae-4ce2-b2cc-becfa85b553c tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:54:08.140259 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-57910d41-d8ae-4ce2-b2cc-becfa85b553c tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:54:08.281632 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-57910d41-d8ae-4ce2-b2cc-becfa85b553c tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172c28d985cb40409d563fad4fa2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3daaf17c3dac442f82831c7df811f511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:54:08.290684 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-57910d41-d8ae-4ce2-b2cc-becfa85b553c tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] 10.222.0.64 "GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6" status: 200 len: 1755 microversion: 2.1 time: 0.163996 May 23 15:54:08.291247 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 554/1146] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:54:08 2022] GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:54:09.317081 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-61af2633-c2ff-4884-9459-c880d2a44965 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:54:09.321849 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-61af2633-c2ff-4884-9459-c880d2a44965 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] [instance: 5010ba7c-c06f-42fc-9868-3782ff2350e6] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:54:09.324383 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-61af2633-c2ff-4884-9459-c880d2a44965 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:54:09.324842 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-61af2633-c2ff-4884-9459-c880d2a44965 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:54:09.325653 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-61af2633-c2ff-4884-9459-c880d2a44965 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:54:09.326096 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-61af2633-c2ff-4884-9459-c880d2a44965 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:54:09.471779 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-61af2633-c2ff-4884-9459-c880d2a44965 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172c28d985cb40409d563fad4fa2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3daaf17c3dac442f82831c7df811f511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:54:09.479909 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-61af2633-c2ff-4884-9459-c880d2a44965 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] 10.222.0.64 "GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6" status: 200 len: 1755 microversion: 2.1 time: 0.174717 May 23 15:54:09.480493 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 593/1147] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:54:09 2022] GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6 => generated 1755 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:54:10.497103 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-a59a409d-d2fd-499e-840b-1a3ae6244e74 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:54:10.497740 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-a59a409d-d2fd-499e-840b-1a3ae6244e74 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] [instance: 5010ba7c-c06f-42fc-9868-3782ff2350e6] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:54:10.504743 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a59a409d-d2fd-499e-840b-1a3ae6244e74 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:54:10.505211 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a59a409d-d2fd-499e-840b-1a3ae6244e74 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:54:10.506050 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a59a409d-d2fd-499e-840b-1a3ae6244e74 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:54:10.506542 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-a59a409d-d2fd-499e-840b-1a3ae6244e74 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:54:10.654686 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-a59a409d-d2fd-499e-840b-1a3ae6244e74 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172c28d985cb40409d563fad4fa2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3daaf17c3dac442f82831c7df811f511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:54:10.662692 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-a59a409d-d2fd-499e-840b-1a3ae6244e74 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] 10.222.0.64 "GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6" status: 200 len: 1755 microversion: 2.1 time: 0.169524 May 23 15:54:10.663254 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 555/1148] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:54:10 2022] GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:54:11.681054 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-b4c0e5a5-dd06-4e99-88ad-c31d7a24400d tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:54:11.681793 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-b4c0e5a5-dd06-4e99-88ad-c31d7a24400d tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] [instance: 5010ba7c-c06f-42fc-9868-3782ff2350e6] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:54:11.688580 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-b4c0e5a5-dd06-4e99-88ad-c31d7a24400d tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:54:11.689663 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-b4c0e5a5-dd06-4e99-88ad-c31d7a24400d tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:54:11.690468 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-b4c0e5a5-dd06-4e99-88ad-c31d7a24400d tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:54:11.690907 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-b4c0e5a5-dd06-4e99-88ad-c31d7a24400d tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:54:11.834759 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-b4c0e5a5-dd06-4e99-88ad-c31d7a24400d tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172c28d985cb40409d563fad4fa2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3daaf17c3dac442f82831c7df811f511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:54:11.842785 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-b4c0e5a5-dd06-4e99-88ad-c31d7a24400d tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] 10.222.0.64 "GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6" status: 200 len: 1755 microversion: 2.1 time: 0.165746 May 23 15:54:11.843433 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 594/1149] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:54:11 2022] GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:54:12.860544 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-e5abb618-6fa0-45e9-add6-75c8c430ce05 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:54:12.861259 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-e5abb618-6fa0-45e9-add6-75c8c430ce05 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] [instance: 5010ba7c-c06f-42fc-9868-3782ff2350e6] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:54:12.868184 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e5abb618-6fa0-45e9-add6-75c8c430ce05 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:54:12.868629 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e5abb618-6fa0-45e9-add6-75c8c430ce05 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:54:12.869416 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e5abb618-6fa0-45e9-add6-75c8c430ce05 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:54:12.869853 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-e5abb618-6fa0-45e9-add6-75c8c430ce05 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:54:13.029946 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-e5abb618-6fa0-45e9-add6-75c8c430ce05 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172c28d985cb40409d563fad4fa2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3daaf17c3dac442f82831c7df811f511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:54:13.038503 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-e5abb618-6fa0-45e9-add6-75c8c430ce05 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] 10.222.0.64 "GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6" status: 200 len: 1755 microversion: 2.1 time: 0.181675 May 23 15:54:13.039169 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 556/1150] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:54:12 2022] GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6 => generated 1755 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:54:14.055973 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-e6dab817-610b-4bd2-9c8f-6f0c2131815e tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:54:14.056690 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-e6dab817-610b-4bd2-9c8f-6f0c2131815e tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] [instance: 5010ba7c-c06f-42fc-9868-3782ff2350e6] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:54:14.063098 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e6dab817-610b-4bd2-9c8f-6f0c2131815e tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:54:14.063543 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e6dab817-610b-4bd2-9c8f-6f0c2131815e tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:54:14.064814 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e6dab817-610b-4bd2-9c8f-6f0c2131815e tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:54:14.065268 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-e6dab817-610b-4bd2-9c8f-6f0c2131815e tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:54:14.206588 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-e6dab817-610b-4bd2-9c8f-6f0c2131815e tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172c28d985cb40409d563fad4fa2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3daaf17c3dac442f82831c7df811f511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:54:14.214516 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-e6dab817-610b-4bd2-9c8f-6f0c2131815e tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] 10.222.0.64 "GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6" status: 200 len: 1755 microversion: 2.1 time: 0.162373 May 23 15:54:14.218733 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 595/1151] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:54:14 2022] GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:54:15.231789 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-8dab9d0c-6a10-46a3-8e3b-95486fc04857 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:54:15.232435 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-8dab9d0c-6a10-46a3-8e3b-95486fc04857 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] [instance: 5010ba7c-c06f-42fc-9868-3782ff2350e6] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:54:15.238917 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-8dab9d0c-6a10-46a3-8e3b-95486fc04857 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:54:15.239363 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-8dab9d0c-6a10-46a3-8e3b-95486fc04857 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:54:15.240125 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-8dab9d0c-6a10-46a3-8e3b-95486fc04857 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:54:15.240557 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-8dab9d0c-6a10-46a3-8e3b-95486fc04857 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:54:15.395191 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-8dab9d0c-6a10-46a3-8e3b-95486fc04857 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172c28d985cb40409d563fad4fa2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3daaf17c3dac442f82831c7df811f511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:54:15.403313 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-8dab9d0c-6a10-46a3-8e3b-95486fc04857 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] 10.222.0.64 "GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6" status: 200 len: 1755 microversion: 2.1 time: 0.175555 May 23 15:54:15.403875 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 557/1152] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:54:15 2022] GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6 => generated 1755 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:54:16.421263 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-ea0062d8-f9c6-45fd-8f05-e117b355dbde tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:54:16.421876 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-ea0062d8-f9c6-45fd-8f05-e117b355dbde tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] [instance: 5010ba7c-c06f-42fc-9868-3782ff2350e6] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:54:16.429046 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ea0062d8-f9c6-45fd-8f05-e117b355dbde tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:54:16.429523 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ea0062d8-f9c6-45fd-8f05-e117b355dbde tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:54:16.430280 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ea0062d8-f9c6-45fd-8f05-e117b355dbde tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:54:16.430717 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-ea0062d8-f9c6-45fd-8f05-e117b355dbde tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:54:16.572128 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-ea0062d8-f9c6-45fd-8f05-e117b355dbde tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172c28d985cb40409d563fad4fa2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3daaf17c3dac442f82831c7df811f511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:54:16.580034 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-ea0062d8-f9c6-45fd-8f05-e117b355dbde tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] 10.222.0.64 "GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6" status: 200 len: 1755 microversion: 2.1 time: 0.162735 May 23 15:54:16.583379 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 596/1153] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:54:16 2022] GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:54:17.597680 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-efbe45a1-f623-40be-a1fb-8992dbb48eac tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:54:17.598300 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-efbe45a1-f623-40be-a1fb-8992dbb48eac tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] [instance: 5010ba7c-c06f-42fc-9868-3782ff2350e6] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:54:17.604943 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-efbe45a1-f623-40be-a1fb-8992dbb48eac tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:54:17.605431 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-efbe45a1-f623-40be-a1fb-8992dbb48eac tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:54:17.606218 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-efbe45a1-f623-40be-a1fb-8992dbb48eac tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:54:17.606660 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-efbe45a1-f623-40be-a1fb-8992dbb48eac tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:54:17.780739 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-efbe45a1-f623-40be-a1fb-8992dbb48eac tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172c28d985cb40409d563fad4fa2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3daaf17c3dac442f82831c7df811f511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:54:17.789766 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-efbe45a1-f623-40be-a1fb-8992dbb48eac tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] 10.222.0.64 "GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6" status: 200 len: 1755 microversion: 2.1 time: 0.195995 May 23 15:54:17.790655 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 558/1154] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:54:17 2022] GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6 => generated 1755 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:54:18.807185 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-cc3cf93a-bf2a-452c-b1d4-c1a6d3d39a4d tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:54:18.807794 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-cc3cf93a-bf2a-452c-b1d4-c1a6d3d39a4d tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] [instance: 5010ba7c-c06f-42fc-9868-3782ff2350e6] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:54:18.814264 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-cc3cf93a-bf2a-452c-b1d4-c1a6d3d39a4d tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:54:18.814709 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-cc3cf93a-bf2a-452c-b1d4-c1a6d3d39a4d tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:54:18.815460 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-cc3cf93a-bf2a-452c-b1d4-c1a6d3d39a4d tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:54:18.816633 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-cc3cf93a-bf2a-452c-b1d4-c1a6d3d39a4d tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:54:18.958391 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-cc3cf93a-bf2a-452c-b1d4-c1a6d3d39a4d tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172c28d985cb40409d563fad4fa2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3daaf17c3dac442f82831c7df811f511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:54:18.966193 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-cc3cf93a-bf2a-452c-b1d4-c1a6d3d39a4d tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] 10.222.0.64 "GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6" status: 200 len: 1758 microversion: 2.1 time: 0.162812 May 23 15:54:18.966755 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 597/1155] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:54:18 2022] GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6 => generated 1758 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:54:47.496673 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-9a20ad0e-9cd1-434b-a951-0c5a92fcc2c8 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1984262076"}} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:54:47.497346 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-9a20ad0e-9cd1-434b-a951-0c5a92fcc2c8 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] [instance: 5010ba7c-c06f-42fc-9868-3782ff2350e6] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:54:47.499385 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_api:SELECT=12 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:54:47.500040 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG dbcounter [-] [124933] Writing DB stats nova_cell1:SELECT=36 {{(pid=124933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:54:47.505136 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-9a20ad0e-9cd1-434b-a951-0c5a92fcc2c8 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:54:47.505598 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-9a20ad0e-9cd1-434b-a951-0c5a92fcc2c8 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:54:47.506368 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-9a20ad0e-9cd1-434b-a951-0c5a92fcc2c8 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:54:47.506807 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-9a20ad0e-9cd1-434b-a951-0c5a92fcc2c8 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:54:47.637088 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.network.security_group_api [None req-9a20ad0e-9cd1-434b-a951-0c5a92fcc2c8 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Removing security group 27d63fb7-8e79-464e-a1a6-5f1640e478ab from port 76ad3e47-7e7d-4fde-9328-3a30596e0087 May 23 15:54:48.069946 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-9a20ad0e-9cd1-434b-a951-0c5a92fcc2c8 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] 10.222.0.64 "POST /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6/action" status: 202 len: 0 microversion: 2.1 time: 0.577564 May 23 15:54:48.074501 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 559/1156] 10.222.0.64 () {60 vars in 1277 bytes} [Mon May 23 15:54:47 2022] POST /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6/action => generated 0 bytes in 579 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 15:54:48.084263 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [req-81df222b-c9b1-44c9-81ab-4b7e75b7250c req-f723dec1-6d44-47a8-97a8-4c7957fa0d99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5010ba7c-c06f-42fc-9868-3782ff2350e6", "tag": "76ad3e47-7e7d-4fde-9328-3a30596e0087"}]} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:54:48.088302 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_api:SELECT=18 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:54:48.088976 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG dbcounter [-] [124934] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 15:54:48.097627 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-81df222b-c9b1-44c9-81ab-4b7e75b7250c req-f723dec1-6d44-47a8-97a8-4c7957fa0d99 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:54:48.109614 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-81df222b-c9b1-44c9-81ab-4b7e75b7250c req-f723dec1-6d44-47a8-97a8-4c7957fa0d99 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:54:48.128607 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.compute.server_external_events [req-81df222b-c9b1-44c9-81ab-4b7e75b7250c req-f723dec1-6d44-47a8-97a8-4c7957fa0d99 service nova] Creating event network-changed:76ad3e47-7e7d-4fde-9328-3a30596e0087 for instance 5010ba7c-c06f-42fc-9868-3782ff2350e6 on hv-cinder-84067 May 23 15:54:48.135963 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [req-81df222b-c9b1-44c9-81ab-4b7e75b7250c req-f723dec1-6d44-47a8-97a8-4c7957fa0d99 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053791 May 23 15:54:48.139263 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 598/1157] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:54:49.266355 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-5083e858-e005-419a-9429-6dd5cc775628 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:54:49.266893 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-5083e858-e005-419a-9429-6dd5cc775628 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] [instance: 5010ba7c-c06f-42fc-9868-3782ff2350e6] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:54:49.267313 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [req-2f56d3ca-9206-46e9-988a-874c256761f8 req-28b703ed-64c5-401a-b425-db60970deab2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5010ba7c-c06f-42fc-9868-3782ff2350e6", "tag": "76ad3e47-7e7d-4fde-9328-3a30596e0087"}]} {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:54:49.273449 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-5083e858-e005-419a-9429-6dd5cc775628 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:54:49.273908 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-5083e858-e005-419a-9429-6dd5cc775628 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:54:49.275422 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-5083e858-e005-419a-9429-6dd5cc775628 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:54:49.275878 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-5083e858-e005-419a-9429-6dd5cc775628 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:54:49.276602 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-2f56d3ca-9206-46e9-988a-874c256761f8 req-28b703ed-64c5-401a-b425-db60970deab2 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:54:49.277050 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [req-2f56d3ca-9206-46e9-988a-874c256761f8 req-28b703ed-64c5-401a-b425-db60970deab2 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:54:49.289350 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.compute.server_external_events [req-2f56d3ca-9206-46e9-988a-874c256761f8 req-28b703ed-64c5-401a-b425-db60970deab2 service nova] Creating event network-changed:76ad3e47-7e7d-4fde-9328-3a30596e0087 for instance 5010ba7c-c06f-42fc-9868-3782ff2350e6 on hv-cinder-84067 May 23 15:54:49.297233 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [req-2f56d3ca-9206-46e9-988a-874c256761f8 req-28b703ed-64c5-401a-b425-db60970deab2 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034201 May 23 15:54:49.310110 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 599/1158] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:54:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:54:49.362396 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.objects.instance [None req-5083e858-e005-419a-9429-6dd5cc775628 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lazy-loading 'services' on Instance uuid 5010ba7c-c06f-42fc-9868-3782ff2350e6 {{(pid=124933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 15:54:49.598649 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-5083e858-e005-419a-9429-6dd5cc775628 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] 10.222.0.64 "DELETE /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6/os-volume_attachments/32d8da76-2d3a-43f7-8fa8-eae488455364" status: 202 len: 0 microversion: 2.1 time: 0.337148 May 23 15:54:49.599160 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 560/1159] 10.222.0.64 () {58 vars in 1415 bytes} [Mon May 23 15:54:49 2022] DELETE /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6/os-volume_attachments/32d8da76-2d3a-43f7-8fa8-eae488455364 => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 15:54:49.609563 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-3ea8816c-8b62-4322-be79-e6b44a371366 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:54:49.610579 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-3ea8816c-8b62-4322-be79-e6b44a371366 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] [instance: 5010ba7c-c06f-42fc-9868-3782ff2350e6] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:54:49.619895 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3ea8816c-8b62-4322-be79-e6b44a371366 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:54:49.620660 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3ea8816c-8b62-4322-be79-e6b44a371366 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:54:49.621698 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3ea8816c-8b62-4322-be79-e6b44a371366 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:54:49.622367 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3ea8816c-8b62-4322-be79-e6b44a371366 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:54:49.654930 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-3ea8816c-8b62-4322-be79-e6b44a371366 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] 10.222.0.64 "GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049998 May 23 15:54:49.656138 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 600/1160] 10.222.0.64 () {58 vars in 1301 bytes} [Mon May 23 15:54:49 2022] GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 15:54:50.668445 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-ad73615a-c9cd-4bd9-bf87-ee79c2b4276a tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:54:50.669696 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-ad73615a-c9cd-4bd9-bf87-ee79c2b4276a tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] [instance: 5010ba7c-c06f-42fc-9868-3782ff2350e6] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:54:50.677054 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ad73615a-c9cd-4bd9-bf87-ee79c2b4276a tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:54:50.677536 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ad73615a-c9cd-4bd9-bf87-ee79c2b4276a tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:54:50.678307 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ad73615a-c9cd-4bd9-bf87-ee79c2b4276a tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:54:50.678743 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-ad73615a-c9cd-4bd9-bf87-ee79c2b4276a tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:54:50.709663 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-ad73615a-c9cd-4bd9-bf87-ee79c2b4276a tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] 10.222.0.64 "GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046279 May 23 15:54:50.710224 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 561/1161] 10.222.0.64 () {58 vars in 1301 bytes} [Mon May 23 15:54:50 2022] GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 15:54:50.720997 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-2dd3774e-0eff-4242-bc78-f3a119d3935d tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:54:50.721545 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-2dd3774e-0eff-4242-bc78-f3a119d3935d tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] [instance: 5010ba7c-c06f-42fc-9868-3782ff2350e6] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:54:50.728473 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2dd3774e-0eff-4242-bc78-f3a119d3935d tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:54:50.730284 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2dd3774e-0eff-4242-bc78-f3a119d3935d tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:54:50.730284 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2dd3774e-0eff-4242-bc78-f3a119d3935d tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:54:50.730700 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-2dd3774e-0eff-4242-bc78-f3a119d3935d tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:54:50.803815 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.wsgi [None req-2dd3774e-0eff-4242-bc78-f3a119d3935d tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] HTTP exception thrown: Instance 5010ba7c-c06f-42fc-9868-3782ff2350e6 is not attached to volume 32d8da76-2d3a-43f7-8fa8-eae488455364 May 23 15:54:50.807136 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-2dd3774e-0eff-4242-bc78-f3a119d3935d tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Request method failure captured: May 23 15:54:50.807136 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: request: DELETE /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6/os-volume_attachments/32d8da76-2d3a-43f7-8fa8-eae488455364 HTTP/1.1 May 23 15:54:50.807136 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Accept: application/json May 23 15:54:50.807136 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Accept-Encoding: identity May 23 15:54:50.807136 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Connection: close May 23 15:54:50.807136 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Content-Length: 0 May 23 15:54:50.807136 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Content-Type: application/json May 23 15:54:50.807136 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Host: 10.222.0.64 May 23 15:54:50.807136 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Openstack-System-Scope: None May 23 15:54:50.807136 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: User-Agent: python-urllib3/1.26.9 May 23 15:54:50.807136 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Auth-Token: gAAAAABii63QmxtLzmEOklO1F1QWNYRGpT3JEKWaEJnBppm-1z-c8QO2wHhBymiJKTTf6ukfll1-7iE_ozrrUQZGZfNgNr7HOSMLNb09bS7NFxDQIYLmPs-e3Zd6-yOcjGxJMZhUT6rjcmRUP25Sz8YjKT35HqIlNCwyhh9_j5CjFRIoo1KHc50 May 23 15:54:50.807136 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Domain-Id: None May 23 15:54:50.807136 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Domain-Name: None May 23 15:54:50.807136 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Identity-Status: Confirmed May 23 15:54:50.807136 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Is-Admin-Project: True May 23 15:54:50.807136 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Domain-Id: default May 23 15:54:50.807136 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Domain-Name: Default May 23 15:54:50.807136 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Id: 3daaf17c3dac442f82831c7df811f511 May 23 15:54:50.807136 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Project-Name: tempest-TestMinimumBasicScenario-1027576231 May 23 15:54:50.807136 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Role: reader,member May 23 15:54:50.807136 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Roles: reader,member May 23 15:54:50.808980 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3daaf17c3dac442f82831c7df811f511"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/3daaf17c3dac442f82831c7df811f511"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3daaf17c3dac442f82831c7df811f511"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_3daaf17c3dac442f82831c7df811f511", "adminURL": "http://10.222.0.64:8080"}]}] May 23 15:54:50.808980 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant: tempest-TestMinimumBasicScenario-1027576231 May 23 15:54:50.808980 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant-Id: 3daaf17c3dac442f82831c7df811f511 May 23 15:54:50.808980 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1027576231 May 23 15:54:50.808980 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User: tempest-TestMinimumBasicScenario-1027576231-project May 23 15:54:50.808980 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Domain-Id: default May 23 15:54:50.808980 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Domain-Name: Default May 23 15:54:50.808980 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Id: 172c28d985cb40409d563fad4fa2ad5c May 23 15:54:50.808980 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: X-User-Name: tempest-TestMinimumBasicScenario-1027576231-project May 23 15:54:50.808980 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: method: > May 23 15:54:50.808980 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: exception: Instance 5010ba7c-c06f-42fc-9868-3782ff2350e6 is not attached to volume 32d8da76-2d3a-43f7-8fa8-eae488455364 May 23 15:54:50.810049 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: action_args: {'server_id': '5010ba7c-c06f-42fc-9868-3782ff2350e6', 'id': '32d8da76-2d3a-43f7-8fa8-eae488455364'} May 23 15:54:50.810049 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:54:50.810049 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:54:50.810049 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 23 15:54:50.810049 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 23 15:54:50.810049 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 23 15:54:50.810049 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 23 15:54:50.810049 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 23 15:54:50.810049 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 23 15:54:50.810049 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 32d8da76-2d3a-43f7-8fa8-eae488455364. May 23 15:54:50.810049 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:54:50.810049 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:54:50.810049 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:54:50.810049 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:54:50.810049 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:54:50.810049 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:54:50.810049 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:54:50.810049 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:54:50.810049 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:54:50.811824 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:54:50.811824 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 23 15:54:50.811824 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 23 15:54:50.811824 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5010ba7c-c06f-42fc-9868-3782ff2350e6 is not attached to volume 32d8da76-2d3a-43f7-8fa8-eae488455364 May 23 15:54:50.811824 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:54:50.811824 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:54:50.811824 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:54:50.811824 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:54:50.811824 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:54:50.811824 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:54:50.811824 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:54:50.811824 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:54:50.811824 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5010ba7c-c06f-42fc-9868-3782ff2350e6 is not attached to volume 32d8da76-2d3a-43f7-8fa8-eae488455364 May 23 15:54:50.811824 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: ERROR nova.api.openstack.wsgi May 23 15:54:50.811824 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-2dd3774e-0eff-4242-bc78-f3a119d3935d tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Returning 404 to user: Instance 5010ba7c-c06f-42fc-9868-3782ff2350e6 is not attached to volume 32d8da76-2d3a-43f7-8fa8-eae488455364 {{(pid=124934) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:54:50.813182 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-2dd3774e-0eff-4242-bc78-f3a119d3935d tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] 10.222.0.64 "DELETE /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6/os-volume_attachments/32d8da76-2d3a-43f7-8fa8-eae488455364" status: 404 len: 154 microversion: 2.1 time: 0.091853 May 23 15:54:50.813182 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 601/1162] 10.222.0.64 () {58 vars in 1415 bytes} [Mon May 23 15:54:50 2022] DELETE /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6/os-volume_attachments/32d8da76-2d3a-43f7-8fa8-eae488455364 => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 15:54:52.122612 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-d2cf66f9-60dd-4e20-b9e6-b40042f4c038 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:54:52.123104 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-d2cf66f9-60dd-4e20-b9e6-b40042f4c038 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] [instance: 5010ba7c-c06f-42fc-9868-3782ff2350e6] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:54:52.129495 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-d2cf66f9-60dd-4e20-b9e6-b40042f4c038 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:54:52.129950 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-d2cf66f9-60dd-4e20-b9e6-b40042f4c038 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:54:52.130724 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-d2cf66f9-60dd-4e20-b9e6-b40042f4c038 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:54:52.131161 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-d2cf66f9-60dd-4e20-b9e6-b40042f4c038 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:54:52.154505 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-d2cf66f9-60dd-4e20-b9e6-b40042f4c038 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] [instance: 5010ba7c-c06f-42fc-9868-3782ff2350e6] Going to try to terminate instance {{(pid=124933) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 15:54:52.495945 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-d2cf66f9-60dd-4e20-b9e6-b40042f4c038 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] 10.222.0.64 "DELETE /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6" status: 204 len: 0 microversion: 2.1 time: 0.377428 May 23 15:54:52.496578 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 562/1163] 10.222.0.64 () {58 vars in 1238 bytes} [Mon May 23 15:54:52 2022] DELETE /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 15:54:52.504992 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-671522e6-acf6-4cd0-9ba2-7a5716861ba0 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:54:52.505623 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-671522e6-acf6-4cd0-9ba2-7a5716861ba0 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] [instance: 5010ba7c-c06f-42fc-9868-3782ff2350e6] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:54:52.513495 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-671522e6-acf6-4cd0-9ba2-7a5716861ba0 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:54:52.513953 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-671522e6-acf6-4cd0-9ba2-7a5716861ba0 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:54:52.514808 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-671522e6-acf6-4cd0-9ba2-7a5716861ba0 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:54:52.515255 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-671522e6-acf6-4cd0-9ba2-7a5716861ba0 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:54:52.643441 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-671522e6-acf6-4cd0-9ba2-7a5716861ba0 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172c28d985cb40409d563fad4fa2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3daaf17c3dac442f82831c7df811f511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:54:52.651350 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-671522e6-acf6-4cd0-9ba2-7a5716861ba0 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] 10.222.0.64 "GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6" status: 200 len: 1552 microversion: 2.1 time: 0.150529 May 23 15:54:52.651897 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 602/1164] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:54:52 2022] GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6 => generated 1552 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:54:53.668891 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-353b49b1-ce8f-40d1-86ac-4b4f368ff581 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:54:53.669614 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-353b49b1-ce8f-40d1-86ac-4b4f368ff581 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] [instance: 5010ba7c-c06f-42fc-9868-3782ff2350e6] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:54:53.676284 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-353b49b1-ce8f-40d1-86ac-4b4f368ff581 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:54:53.676730 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-353b49b1-ce8f-40d1-86ac-4b4f368ff581 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:54:53.677533 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-353b49b1-ce8f-40d1-86ac-4b4f368ff581 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:54:53.677973 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-353b49b1-ce8f-40d1-86ac-4b4f368ff581 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:54:53.810645 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.policy [None req-353b49b1-ce8f-40d1-86ac-4b4f368ff581 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172c28d985cb40409d563fad4fa2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3daaf17c3dac442f82831c7df811f511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124933) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:54:53.818094 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-353b49b1-ce8f-40d1-86ac-4b4f368ff581 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] 10.222.0.64 "GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6" status: 200 len: 1552 microversion: 2.1 time: 0.154047 May 23 15:54:53.818770 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 563/1165] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:54:53 2022] GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6 => generated 1552 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:54:54.836178 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-6a4e1b08-5c80-477b-98df-4bcd80f6e0b1 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:54:54.836799 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-6a4e1b08-5c80-477b-98df-4bcd80f6e0b1 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] [instance: 5010ba7c-c06f-42fc-9868-3782ff2350e6] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:54:54.843592 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-6a4e1b08-5c80-477b-98df-4bcd80f6e0b1 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:54:54.844051 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-6a4e1b08-5c80-477b-98df-4bcd80f6e0b1 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:54:54.844837 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-6a4e1b08-5c80-477b-98df-4bcd80f6e0b1 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:54:54.845307 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-6a4e1b08-5c80-477b-98df-4bcd80f6e0b1 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:54:55.011307 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-6a4e1b08-5c80-477b-98df-4bcd80f6e0b1 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172c28d985cb40409d563fad4fa2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3daaf17c3dac442f82831c7df811f511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:54:55.018928 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-6a4e1b08-5c80-477b-98df-4bcd80f6e0b1 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] 10.222.0.64 "GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6" status: 200 len: 1552 microversion: 2.1 time: 0.186985 May 23 15:54:55.019894 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 603/1166] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:54:54 2022] GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6 => generated 1552 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:54:55.152811 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [req-3e5bef1d-0b04-4df1-a0e6-f2d28a09b5a8 req-46c6c410-5be3-4fa7-9e12-baf82fab2e76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5010ba7c-c06f-42fc-9868-3782ff2350e6", "name": "network-vif-deleted", "tag": "76ad3e47-7e7d-4fde-9328-3a30596e0087"}]} {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 15:54:55.161927 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-3e5bef1d-0b04-4df1-a0e6-f2d28a09b5a8 req-46c6c410-5be3-4fa7-9e12-baf82fab2e76 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:54:55.162379 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [req-3e5bef1d-0b04-4df1-a0e6-f2d28a09b5a8 req-46c6c410-5be3-4fa7-9e12-baf82fab2e76 service nova] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:54:55.175711 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.compute.server_external_events [req-3e5bef1d-0b04-4df1-a0e6-f2d28a09b5a8 req-46c6c410-5be3-4fa7-9e12-baf82fab2e76 service nova] Creating event network-vif-deleted:76ad3e47-7e7d-4fde-9328-3a30596e0087 for instance 5010ba7c-c06f-42fc-9868-3782ff2350e6 on hv-cinder-84067 May 23 15:54:55.180906 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [req-3e5bef1d-0b04-4df1-a0e6-f2d28a09b5a8 req-46c6c410-5be3-4fa7-9e12-baf82fab2e76 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032436 May 23 15:54:55.182818 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 564/1167] 10.222.0.64 () {64 vars in 1317 bytes} [Mon May 23 15:54:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 15:54:56.035755 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-3010f7ac-b02d-4313-8eab-c38ad4472b4c tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Calling method '>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:54:56.036453 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.compute.api [None req-3010f7ac-b02d-4313-8eab-c38ad4472b4c tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] [instance: 5010ba7c-c06f-42fc-9868-3782ff2350e6] Fetching instance by UUID {{(pid=124934) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:54:56.049465 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3010f7ac-b02d-4313-8eab-c38ad4472b4c tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:54:56.049465 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3010f7ac-b02d-4313-8eab-c38ad4472b4c tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:54:56.049465 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3010f7ac-b02d-4313-8eab-c38ad4472b4c tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:54:56.049465 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3010f7ac-b02d-4313-8eab-c38ad4472b4c tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:54:56.077132 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3010f7ac-b02d-4313-8eab-c38ad4472b4c tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:54:56.077590 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG oslo_concurrency.lockutils [None req-3010f7ac-b02d-4313-8eab-c38ad4472b4c tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124934) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:54:56.082000 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.objects.instance [None req-3010f7ac-b02d-4313-8eab-c38ad4472b4c tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lazy-loading 'fault' on Instance uuid 5010ba7c-c06f-42fc-9868-3782ff2350e6 {{(pid=124934) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 15:54:56.121635 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.policy [None req-3010f7ac-b02d-4313-8eab-c38ad4472b4c tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172c28d985cb40409d563fad4fa2ad5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3daaf17c3dac442f82831c7df811f511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124934) authorize /opt/stack/nova/nova/policy.py:199}} May 23 15:54:56.128964 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-3010f7ac-b02d-4313-8eab-c38ad4472b4c tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] 10.222.0.64 "GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6" status: 200 len: 1347 microversion: 2.1 time: 0.097069 May 23 15:54:56.129545 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 604/1168] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:54:56 2022] GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6 => generated 1347 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 15:54:57.148693 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-4f2b718c-35ae-485d-84cf-2dabe598bef0 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Calling method '>' {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:54:57.149424 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.compute.api [None req-4f2b718c-35ae-485d-84cf-2dabe598bef0 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] [instance: 5010ba7c-c06f-42fc-9868-3782ff2350e6] Fetching instance by UUID {{(pid=124933) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 15:54:57.156267 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-4f2b718c-35ae-485d-84cf-2dabe598bef0 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:54:57.156720 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-4f2b718c-35ae-485d-84cf-2dabe598bef0 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:54:57.157519 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-4f2b718c-35ae-485d-84cf-2dabe598bef0 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 15:54:57.157959 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG oslo_concurrency.lockutils [None req-4f2b718c-35ae-485d-84cf-2dabe598bef0 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Lock "ad186f54-45d6-4a29-af7e-16215b0c4892" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 15:54:57.171662 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.wsgi [None req-4f2b718c-35ae-485d-84cf-2dabe598bef0 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] HTTP exception thrown: Instance 5010ba7c-c06f-42fc-9868-3782ff2350e6 could not be found. May 23 15:54:57.173340 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-4f2b718c-35ae-485d-84cf-2dabe598bef0 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Request method failure captured: May 23 15:54:57.173340 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: request: GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6 HTTP/1.1 May 23 15:54:57.173340 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Accept: application/json May 23 15:54:57.173340 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Accept-Encoding: identity May 23 15:54:57.173340 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Connection: close May 23 15:54:57.173340 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Content-Length: 0 May 23 15:54:57.173340 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Content-Type: application/json May 23 15:54:57.173340 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Host: 10.222.0.64 May 23 15:54:57.173340 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Openstack-System-Scope: None May 23 15:54:57.173340 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: User-Agent: python-urllib3/1.26.9 May 23 15:54:57.173340 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Auth-Token: gAAAAABii63QmxtLzmEOklO1F1QWNYRGpT3JEKWaEJnBppm-1z-c8QO2wHhBymiJKTTf6ukfll1-7iE_ozrrUQZGZfNgNr7HOSMLNb09bS7NFxDQIYLmPs-e3Zd6-yOcjGxJMZhUT6rjcmRUP25Sz8YjKT35HqIlNCwyhh9_j5CjFRIoo1KHc50 May 23 15:54:57.173340 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Domain-Id: None May 23 15:54:57.173340 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Domain-Name: None May 23 15:54:57.173340 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Identity-Status: Confirmed May 23 15:54:57.173340 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Is-Admin-Project: True May 23 15:54:57.173340 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Domain-Id: default May 23 15:54:57.173340 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Domain-Name: Default May 23 15:54:57.173340 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Id: 3daaf17c3dac442f82831c7df811f511 May 23 15:54:57.173340 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Project-Name: tempest-TestMinimumBasicScenario-1027576231 May 23 15:54:57.173340 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Role: reader,member May 23 15:54:57.173340 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Roles: reader,member May 23 15:54:57.175242 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3daaf17c3dac442f82831c7df811f511"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/3daaf17c3dac442f82831c7df811f511"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3daaf17c3dac442f82831c7df811f511"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_3daaf17c3dac442f82831c7df811f511", "adminURL": "http://10.222.0.64:8080"}]}] May 23 15:54:57.175242 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant: tempest-TestMinimumBasicScenario-1027576231 May 23 15:54:57.175242 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant-Id: 3daaf17c3dac442f82831c7df811f511 May 23 15:54:57.175242 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1027576231 May 23 15:54:57.175242 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User: tempest-TestMinimumBasicScenario-1027576231-project May 23 15:54:57.175242 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Domain-Id: default May 23 15:54:57.175242 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Domain-Name: Default May 23 15:54:57.175242 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Id: 172c28d985cb40409d563fad4fa2ad5c May 23 15:54:57.175242 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: X-User-Name: tempest-TestMinimumBasicScenario-1027576231-project May 23 15:54:57.175242 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: method: > May 23 15:54:57.175242 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: exception: Instance 5010ba7c-c06f-42fc-9868-3782ff2350e6 could not be found. May 23 15:54:57.175242 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: action_args: {'id': '5010ba7c-c06f-42fc-9868-3782ff2350e6'} May 23 15:54:57.176142 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: {{(pid=124933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 15:54:57.176142 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:54:57.176142 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 15:54:57.176142 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 15:54:57.176142 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 15:54:57.176142 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 15:54:57.176142 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 15:54:57.176142 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 15:54:57.176142 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 15:54:57.176142 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 15:54:57.176142 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5010ba7c-c06f-42fc-9868-3782ff2350e6 could not be found. May 23 15:54:57.176142 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:54:57.176142 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:54:57.176142 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:54:57.176142 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:54:57.176142 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:54:57.176142 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:54:57.176142 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 15:54:57.176142 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 15:54:57.176142 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 15:54:57.177796 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 15:54:57.177796 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 15:54:57.177796 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 15:54:57.177796 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 15:54:57.177796 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 15:54:57.177796 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 15:54:57.177796 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 15:54:57.177796 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5010ba7c-c06f-42fc-9868-3782ff2350e6 could not be found. May 23 15:54:57.177796 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:54:57.177796 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 15:54:57.177796 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:54:57.177796 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 15:54:57.177796 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 15:54:57.177796 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 15:54:57.177796 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 15:54:57.177796 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 15:54:57.177796 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5010ba7c-c06f-42fc-9868-3782ff2350e6 could not be found. May 23 15:54:57.177796 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: ERROR nova.api.openstack.wsgi May 23 15:54:57.179350 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: DEBUG nova.api.openstack.wsgi [None req-4f2b718c-35ae-485d-84cf-2dabe598bef0 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Returning 404 to user: Instance 5010ba7c-c06f-42fc-9868-3782ff2350e6 could not be found. {{(pid=124933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 15:54:57.179350 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO nova.api.openstack.requestlog [None req-4f2b718c-35ae-485d-84cf-2dabe598bef0 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] 10.222.0.64 "GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6" status: 404 len: 111 microversion: 2.1 time: 0.031028 May 23 15:54:57.179350 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: [pid: 124933|app: 0|req: 565/1169] 10.222.0.64 () {58 vars in 1235 bytes} [Mon May 23 15:54:57 2022] GET /compute/v2.1/servers/5010ba7c-c06f-42fc-9868-3782ff2350e6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 15:54:57.184646 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: DEBUG nova.api.openstack.wsgi [None req-1fe8a94a-db6e-483c-a057-f44cf5281d24 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] Calling method '.version_select at 0x7fab5701c280>' {{(pid=124934) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 15:54:57.301297 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO nova.api.openstack.requestlog [None req-1fe8a94a-db6e-483c-a057-f44cf5281d24 tempest-TestMinimumBasicScenario-1027576231 tempest-TestMinimumBasicScenario-1027576231-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-338991248" status: 202 len: 0 microversion: 2.1 time: 0.120366 May 23 15:54:57.301879 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: [pid: 124934|app: 0|req: 605/1170] 10.222.0.64 () {58 vars in 1268 bytes} [Mon May 23 15:54:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-338991248 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 15:56:24.594768 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 15:56:24.595429 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Mon May 23 15:56:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 15:56:37.027883 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 15:56:37.028614 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Mon May 23 15:56:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 15:57:05.568110 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 15:57:05.568751 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Mon May 23 15:57:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 15:57:16.206438 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 15:57:16.207036 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Mon May 23 15:57:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 15:58:31.856541 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 15:58:31.857180 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Mon May 23 15:58:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 15:59:44.605245 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 15:59:44.605858 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Mon May 23 15:59:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 15:59:57.036410 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 15:59:57.037140 dv-cinder-840678-12-iscsi devstack@n-api.service[124933]: Mon May 23 15:59:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 16:00:06.425180 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 16:00:06.425750 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Mon May 23 16:00:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 16:00:25.576435 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 16:00:25.577203 dv-cinder-840678-12-iscsi devstack@n-api.service[124934]: Mon May 23 16:00:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!